Apr 08 10:57:42 devstack cinder-volume[72415]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 08 10:57:42 devstack cinder-volume[72415]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 10:57:42 devstack cinder-volume[72415]: we strongly recommend against using it for new projects.
Apr 08 10:57:42 devstack cinder-volume[72415]: If you are already using Eventlet, we recommend migrating to a different
Apr 08 10:57:42 devstack cinder-volume[72415]: framework.  For more detail see
Apr 08 10:57:42 devstack cinder-volume[72415]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 10:57:42 devstack cinder-volume[72415]:   import eventlet  # noqa
Apr 08 10:57:43 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 10:57:43 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 10:57:43 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO dbcounter [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Registered counter for database cinder
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_db.sqlalchemy.engines [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG dbcounter [-] [72415] Writer thread running {{(pid=72415) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.rpc [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.rpc [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_db.sqlalchemy.engines [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.volume.manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Determined volume DB was empty at startup.
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG cinder.volume.manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72415) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.volume.manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING stevedore.named [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING castellan.key_manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING cinder.keymgr.conf_key_mgr [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG cinder.volume.drivers.lvm [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72415) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_concurrency.processutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72415) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_concurrency.processutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.227s {{(pid=72415) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_db.sqlalchemy.engines [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.rpc [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.rpc [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING stevedore.named [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING castellan.key_manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO cinder.volume.manager [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_db.sqlalchemy.engines [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72415) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 10:57:44 devstack cinder-volume[72415]: INFO oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Starting 1 workers
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Started child 72520 {{(pid=72415) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Full set of CONF: {{(pid=72415) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] ******************************************************************************** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Configuration options gathered from: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] ================================================================================ {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 08 10:57:44 devstack cinder-volume[72520]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] allow_availability_zone_fallback = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] allow_compression_on_image_upload = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] allowed_direct_url_schemes     = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] api_rate_limit                 = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] auth_strategy                  = keystone {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] az_cache_duration              = 3600 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_availability_zone      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_host                   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_name                   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_stats_polling_interval = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backup_api_class               = cinder.backup.api.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backup_name_template           = backup-%s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backup_use_same_host           = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backup_use_temp_snapshot       = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] chap_password                  = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] chap_username                  =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_internal_tenant_project_id = 290d472a8b424a8e96d7834eca60efba {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_internal_tenant_user_id = bb02730f02b84012bdb1da17df34ffb1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cloned_volume_same_az          = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cluster                        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] compression_format             = gzip {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] config_dir                     = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] config_source                  = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] control_exchange               = openstack {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] debug                          = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] default_availability_zone      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] default_group_type             = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] default_volume_type            = lvmdriver-1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] disk_geometry                  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_client_cert             = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_client_cert_key         = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_data_namespace          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_ssl_cert_path           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_ssl_cert_verify         = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] driver_use_ssl                 = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] enable_force_upload            = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] enable_new_services            = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] enable_unsupported_driver      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] enforce_multipath_for_image_xfer = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] filter_function                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_api_insecure            = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_api_servers             = ['http://192.168.122.165/image'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_api_ssl_compression     = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_ca_certificates_file    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_certfile                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_keyfile                 = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_num_retries             = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance_request_timeout         = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] goodness_function              = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] graceful_shutdown_timeout      = 5 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] group_api_class                = cinder.group.api.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] host                           = devstack {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_compress_on_upload       = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_conversion_address_space_limit = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_conversion_cpu_limit     = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72520]: INFO cinder.volume.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_conversion_disable       = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_upload_use_cinder_backend = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_upload_use_internal_tenant = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_volume_cache_enabled     = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_volume_cache_max_count   = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] image_volume_cache_max_size_gb = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] init_host_max_objects_retrieval = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iscsi_target_flags             =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iscsi_write_cache              = on {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iser_helper                    = tgtadm {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iser_ip_address                = 192.168.122.165 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iser_port                      = 3260 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_color                      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_config_append              = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_dir                        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_file                       = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_options                    = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_rotate_interval            = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_rotate_interval_type       = days {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] log_rotation_type              = none {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] max_age                        = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] max_logfile_count              = 30 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] max_logfile_size_mb            = 200 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] max_over_subscription_ratio    = 20.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] message_reap_interval          = 86400 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] message_ttl                    = 2592000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] migration_create_volume_timeout_secs = 300 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] monkey_patch                   = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] monkey_patch_modules           = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] my_ip                          = 192.168.122.165 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] no_snapshot_gb_quota           = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] num_iser_scan_tries            = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] num_shell_tries                = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] num_volume_device_scan_tries   = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] nvmeof_conn_info_version       = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] nvmet_ns_id                    = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] nvmet_port_id                  = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_max_limit                = 1000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_ext_list          = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_listen_port       = 8776 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_use_ssl           = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] osapi_volume_workers           = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] per_volume_size_limit          = -1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] periodic_fuzzy_delay           = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] periodic_interval              = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] public_endpoint                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] publish_errors                 = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_backup_gigabytes         = 1000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_backups                  = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_gigabytes                = 1000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_groups                   = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_snapshots                = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] quota_volumes                  = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] rate_limit_burst               = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] rate_limit_except_level        = CRITICAL {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] rate_limit_interval            = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] reinit_driver_count            = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] replication_device             = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] report_discard_supported       = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] report_interval                = 120 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] reservation_clean_interval     = 86400 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] reservation_expire             = 86400 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] reserved_image_namespaces      = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] reserved_percentage            = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] rpc_response_timeout           = 120 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] run_external_periodic_tasks    = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] scst_target_driver             = iscsi {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] scst_target_iqn_name           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_down_time              = 720 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] shell_completion               = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] snapshot_name_template         = snapshot-%s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] snapshot_same_host             = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] split_loggers                  = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] state_path                     = /opt/stack/data/cinder {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] storage_availability_zone      = nova {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] storage_protocol               = iSCSI {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] syslog_log_facility            = LOG_USER {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_helper                  = lioadm {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_ip_address              = 192.168.122.165 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_port                    = 3260 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_protocol                = iscsi {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] target_secondary_ip_addresses  = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] trace_flags                    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] transport_url                  = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] until_refresh                  = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_chap_auth                  = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_default_quota_class        = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_journal                    = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_json                       = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_multipath_for_image_xfer   = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_stderr                     = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] use_syslog                     = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] verify_glance_signatures       = enabled {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_api_class               = cinder.volume.api.API {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_backend_name            = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_clear                   = zero {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_clear_ionice            = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_clear_size              = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_copy_bps_limit          = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_dd_blocksize            = 1M {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_name_template           = volume-%s {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_service_inithost_offload = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volume_usage_audit_period      = month {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] zoning_mode                    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_concurrency.disable_process_locking = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.admin_password = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.admin_token = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.admin_user  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_protocol = https {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_section = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_type   = password {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_uri    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.auth_version = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.cache       = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.certfile    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.identity_uri = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.include_service_catalog = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.insecure    = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.interface   = public {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.keyfile     = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_password =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcache_username =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.region_name = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.service_type = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.backend                  = dogpile.cache.null {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.backend_argument         = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.backend_expiration_time  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.config_prefix            = cache.oslo {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.debug_cache_backend      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.enable_retry_client      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.enable_socket_keepalive  = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.enabled                  = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.enforce_fips_mode        = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.expiration_time          = 600 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.hashclient_retry_attempts = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_dead_retry      = 300 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_sasl_enabled    = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.password                 = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.proxies                  = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.redis_db                 = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.redis_server             = localhost:6379 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.retry_attempts           = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.retry_delay              = 0.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.socket_keepalive_count   = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.socket_keepalive_idle    = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.socket_keepalive_interval = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.socket_timeout           = 1.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.tls_allowed_ciphers      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.tls_cafile               = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.tls_certfile             = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.tls_enabled              = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.tls_keyfile              = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cache.username                 = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] coordination.backend_url       = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.asyncio_connection    = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.asyncio_slave_connection = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.backend               = sqlalchemy {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.connection            = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.connection_debug      = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.connection_parameters =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.connection_recycle_time = 3600 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.connection_trace      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.db_inc_retry_interval = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.db_max_retries        = 20 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.db_max_retry_interval = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.db_retry_interval     = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.max_overflow          = 50 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.max_pool_size         = 5 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.max_retries           = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.mysql_wsrep_sync_wait = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.pool_timeout          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.retry_interval        = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.slave_connection      = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.sqlite_synchronous    = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.synchronous_reader    = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] database.use_db_reconnect      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.connection_string     = messaging:// {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.enabled               = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.es_doc_type           = notification {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.es_scroll_size        = 10000 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.es_scroll_time        = 2m {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.filter_error_trace    = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.hmac_keys             = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.sentinel_service_name = mymaster {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.socket_timeout        = 0.1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.trace_requests        = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler.trace_sqlalchemy      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler_jaeger.process_tags   = {} {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler_jaeger.service_name_prefix = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] profiler_otlp.service_name_prefix = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.enforce_new_defaults = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: WARNING oslo_config.cfg [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.enforce_scope      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.policy_default_rule = default {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.group          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.helper_command = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] privsep_osbrick.user           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.group         = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.helper_command = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] cinder_sys_admin.user          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.auth_section      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.auth_type         = password {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.cafile            = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.certfile          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.collect_timing    = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.insecure          = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.keyfile           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.send_service_user_token = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.split_loggers     = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] service_user.timeout           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.auth_section            = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack sudo[72524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.auth_type               = password {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.certfile                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack sudo[72524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.collect_timing          = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.insecure                = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.keyfile                 = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.region_name             = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.split_loggers           = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] glance.timeout                 = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.backend_availability_zone = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.chap_password = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.chap_username =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.disk_geometry = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_client_cert = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_client_cert_key = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_data_namespace = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.driver_use_ssl = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.extra_capabilities = {} {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.filter_function = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.goodness_function = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iscsi_target_flags =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iscsi_write_cache = on {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iser_port     = 3260 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.lvm_share_target = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.lvm_type      = auto {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.num_shell_tries = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.replication_device = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.report_discard_supported = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.reserved_percentage = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_helper = tgtadm {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_port   = 3260 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_protocol = iscsi {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.trace_flags   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.unique_fqdn_network = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.use_chap_auth = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_backend_name = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_clear  = zero {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_clear_ionice = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_clear_size = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_reports.file_event_handler = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_reports.log_dir           = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.backend_host       = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.chap_password      = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.chap_username      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.disk_geometry      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_client_cert = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.extra_capabilities = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.filter_function    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.goodness_function  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:44 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iser_helper        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iser_port          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.lvm_type           = auto {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.replication_device = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.report_discard_supported = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.reserved_percentage = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.scst_target_driver = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.storage_protocol   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_ip_address  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_port        = 3260 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.trace_flags        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_clear       = zero {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] lvmdriver-1.volumes_dir        = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_notifications.driver = [] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_notifications.retry = -1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] key_manager.fixed_key          = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.barbican_api_version  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.barbican_endpoint     = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.barbican_endpoint_type = public {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.barbican_region_name  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.cafile                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.certfile              = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.collect_timing        = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.insecure              = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.keyfile               = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.number_of_retries     = 60 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.retry_delay           = 1 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.send_service_user_token = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.split_loggers         = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.timeout               = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.verify_ssl            = True {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican.verify_ssl_path       = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.auth_section = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.auth_type = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.cafile   = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.certfile = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.collect_timing = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.insecure = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.keyfile  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.split_loggers = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] barbican_service_user.timeout  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.approle_role_id          = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.approle_secret_id        = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.kv_mountpoint            = secret {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.kv_path                  = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.kv_version               = 2 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.namespace                = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.root_token_id            = **** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.ssl_ca_crt_file          = None {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.timeout                  = 60.0 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.use_ssl                  = False {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 10:57:45 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] ******************************************************************************** {{(pid=72415) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 08 10:57:45 devstack sudo[72524]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:45 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:45 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:45 devstack sudo[72600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:45 devstack sudo[72600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:46 devstack sudo[72600]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.495s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 10:57:46 devstack cinder-volume[72520]: INFO cinder.brick.local_dev.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:46 devstack sudo[72808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:46 devstack sudo[72808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:46 devstack sudo[72808]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG cinder.brick.local_dev.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72520) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 08 10:57:46 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:46 devstack sudo[73011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:46 devstack sudo[73011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:47 devstack sudo[73011]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:47 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.013s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:47 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:47 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:47 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:47 devstack sudo[73179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:47 devstack sudo[73179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:48 devstack sudo[73179]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:48 devstack sudo[73220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 08 10:57:48 devstack sudo[73220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:48 devstack sudo[73220]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.450s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:48 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:48 devstack sudo[73223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:48 devstack sudo[73223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:49 devstack sudo[73223]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:49 devstack sudo[73228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:49 devstack sudo[73228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:49 devstack sudo[73228]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:49 devstack sudo[73231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:49 devstack sudo[73231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:49 devstack sudo[73231]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:49 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:49 devstack sudo[73239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:49 devstack sudo[73239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:50 devstack sudo[73239]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:50 devstack sudo[73243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:50 devstack sudo[73243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:50 devstack sudo[73243]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:50 devstack cinder-volume[72520]: INFO cinder.volume.drivers.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:50 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:50 devstack sudo[73253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:50 devstack sudo[73253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:51 devstack sudo[73253]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:51 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:51 devstack cinder-volume[72520]: DEBUG cinder.volume.drivers.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Updating volume stats {{(pid=72520) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 08 10:57:51 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:51 devstack sudo[73366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:51 devstack sudo[73366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:51 devstack sudo[73366]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:51 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:51 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:51 devstack sudo[73442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:51 devstack sudo[73442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:52 devstack sudo[73442]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:52 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:52 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:52 devstack sudo[73512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:52 devstack sudo[73512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:52 devstack sudo[73512]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:52 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:52 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:52 devstack sudo[73515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:52 devstack sudo[73515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:53 devstack sudo[73515]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:53 devstack cinder-volume[72520]: INFO cinder.volume.driver [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Driver hasn't implemented _init_vendor_properties()
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG cinder.volume.driver [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72520) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG oslo_db.sqlalchemy.engines [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72520) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG dbcounter [-] [72520] Writer thread running {{(pid=72520) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG cinder.db.sqlalchemy.api [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Building query based on filter {{(pid=72520) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG cinder.image.image_utils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72520) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 08 10:57:53 devstack cinder-volume[72520]: INFO cinder.keymgr.migration [None req-11d8bf91-150d-424a-95f6-7bb1c71d1266 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG cinder.volume.drivers.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Updating volume stats {{(pid=72520) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:53 devstack sudo[73522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:53 devstack sudo[73522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:53 devstack sudo[73522]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:53 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:53 devstack sudo[73528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:53 devstack sudo[73528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:54 devstack sudo[73528]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:54 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:54 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:54 devstack sudo[73531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:54 devstack sudo[73531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:54 devstack sudo[73531]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:54 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:54 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:54 devstack sudo[73536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:54 devstack sudo[73536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:54 devstack cinder-volume[72415]: DEBUG dbcounter [-] [72415] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72415) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 10:57:55 devstack sudo[73536]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG cinder.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Notifying Schedulers of capabilities ... {{(pid=72520) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 10:57:55 devstack cinder-volume[72520]: INFO cinder.volume.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Driver initialization completed successfully.
Apr 08 10:57:55 devstack cinder-volume[72520]: INFO cinder.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Initiating service 2 cleanup
Apr 08 10:57:55 devstack cinder-volume[72520]: INFO cinder.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Service 2 cleanup completed.
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG cinder.service [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Creating RPC server for service cinder-volume {{(pid=72520) start /opt/stack/cinder/cinder/service.py:231}}
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG cinder.service [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72520) start /opt/stack/cinder/cinder/service.py:237}}
Apr 08 10:57:55 devstack cinder-volume[72520]: INFO cinder.volume.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG cinder.volume.drivers.lvm [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Updating volume stats {{(pid=72520) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:55 devstack sudo[73542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:57:55 devstack sudo[73542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:55 devstack sudo[73542]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:55 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:55 devstack sudo[73548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:55 devstack sudo[73548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:56 devstack sudo[73548]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:56 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:56 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:56 devstack sudo[73605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:57:56 devstack sudo[73605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:56 devstack sudo[73605]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:56 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:56 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:57:56 devstack sudo[73608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:57:56 devstack sudo[73608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:57:57 devstack sudo[73608]: pam_unix(sudo:session): session closed for user root
Apr 08 10:57:57 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:57:57 devstack cinder-volume[72520]: INFO cinder.volume.manager [None req-5bbc338c-c986-4cc9-8651-a2177d31b070 None None] Driver post RPC initialization completed successfully.
Apr 08 10:58:07 devstack cinder-volume[72520]: DEBUG dbcounter [-] [72520] Writing DB stats cinder:SELECT=4 {{(pid=72520) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 10:58:07 devstack cinder-volume[72520]: DEBUG dbcounter [-] [72520] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72520) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_service.periodic_task [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG cinder.volume.drivers.lvm [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Updating volume stats {{(pid=72520) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:59:30 devstack sudo[78609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 10:59:30 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:59:30 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:59:30 devstack sudo[78612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:59:30 devstack sudo[78612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:59:30 devstack sudo[78612]: pam_unix(sudo:session): session closed for user root
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:59:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:59:30 devstack sudo[78615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 10:59:30 devstack sudo[78615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:59:31 devstack sudo[78615]: pam_unix(sudo:session): session closed for user root
Apr 08 10:59:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:59:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 10:59:31 devstack sudo[78619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 10:59:31 devstack sudo[78619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 10:59:31 devstack sudo[78619]: pam_unix(sudo:session): session closed for user root
Apr 08 10:59:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 10:59:31 devstack cinder-volume[72520]: DEBUG cinder.manager [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Notifying Schedulers of capabilities ... {{(pid=72520) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:00:07 devstack cinder-volume[72520]: DEBUG dbcounter [-] [72520] Writing DB stats cinder:SELECT=1 {{(pid=72520) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:00:07 devstack cinder-volume[72520]: DEBUG dbcounter [-] [72520] Writing DB stats cinder:UPDATE=1 {{(pid=72520) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_service.periodic_task [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72520) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG cinder.volume.drivers.lvm [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Updating volume stats {{(pid=72520) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:00:30 devstack sudo[80733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 08 11:00:30 devstack sudo[80733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:00:30 devstack sudo[80733]: pam_unix(sudo:session): session closed for user root
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:00:30 devstack sudo[80759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 11:00:30 devstack sudo[80759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:00:30 devstack sudo[80759]: pam_unix(sudo:session): session closed for user root
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:00:30 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:00:30 devstack sudo[80765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 08 11:00:30 devstack sudo[80765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:00:31 devstack sudo[80765]: pam_unix(sudo:session): session closed for user root
Apr 08 11:00:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.417s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:00:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:00:31 devstack sudo[80769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 08 11:00:31 devstack sudo[80769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:00:31 devstack sudo[80769]: pam_unix(sudo:session): session closed for user root
Apr 08 11:00:31 devstack cinder-volume[72520]: DEBUG oslo_concurrency.processutils [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=72520) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:00:31 devstack cinder-volume[72520]: DEBUG cinder.manager [None req-22242d0e-74b9-4148-89fe-544b8bf690a6 None None] Notifying Schedulers of capabilities ... {{(pid=72520) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:01:11 devstack cinder-volume[72415]: INFO oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Caught SIGTERM, stopping children
Apr 08 11:01:11 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Acquiring lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:11 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Acquired lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:11 devstack cinder-volume[72415]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Releasing lock "singleton_lock" {{(pid=72415) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:11 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Stop services. {{(pid=72415) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 08 11:01:11 devstack cinder-volume[72415]: DEBUG oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Killing children. {{(pid=72415) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 08 11:01:11 devstack cinder-volume[72415]: INFO oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Waiting on 1 children to exit
Apr 08 11:01:15 devstack cinder-volume[72520]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Acquiring lock "singleton_lock" {{(pid=72520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:15 devstack cinder-volume[72520]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Acquired lock "singleton_lock" {{(pid=72520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:15 devstack cinder-volume[72520]: DEBUG oslo_concurrency.lockutils [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Releasing lock "singleton_lock" {{(pid=72520) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:15 devstack cinder-volume[72520]: WARNING amqp [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 08 11:01:15 devstack cinder-volume[72520]: WARNING amqp [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 08 11:01:15 devstack cinder-volume[72415]: INFO oslo_service.backend._eventlet.service [None req-58a4a64f-956b-4c6d-9d79-c6f382fc3cf9 None None] Child 72520 exited with status 0
Apr 08 11:01:15 devstack cinder-volume[81722]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 08 11:01:15 devstack cinder-volume[81722]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 11:01:15 devstack cinder-volume[81722]: we strongly recommend against using it for new projects.
Apr 08 11:01:15 devstack cinder-volume[81722]: If you are already using Eventlet, we recommend migrating to a different
Apr 08 11:01:15 devstack cinder-volume[81722]: framework.  For more detail see
Apr 08 11:01:15 devstack cinder-volume[81722]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 11:01:15 devstack cinder-volume[81722]:   import eventlet  # noqa
Apr 08 11:01:17 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:17 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:17 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO dbcounter [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Registered counter for database cinder
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG dbcounter [-] [81722] Writer thread running {{(pid=81722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO cinder.rpc [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO cinder.rpc [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO cinder.volume.manager [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Determined volume DB was empty at startup.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG cinder.volume.manager [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81722) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO cinder.volume.manager [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 08 11:01:18 devstack cinder-volume[81722]: WARNING stevedore.named [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 08 11:01:18 devstack cinder-volume[81722]: WARNING castellan.key_manager [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 11:01:18 devstack cinder-volume[81722]: WARNING cinder.keymgr.conf_key_mgr [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO cinder.volume.manager [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:18 devstack cinder-volume[81722]: INFO oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Starting 1 workers
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Started child 82279 {{(pid=81722) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Full set of CONF: {{(pid=81722) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] ******************************************************************************** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Configuration options gathered from: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] ================================================================================ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] allow_availability_zone_fallback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] allow_compression_on_image_upload = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] allowed_direct_url_schemes     = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] api_rate_limit                 = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] auth_strategy                  = keystone {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_availability_zone      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_host                   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_name                   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_stats_polling_interval = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backup_api_class               = cinder.backup.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backup_name_template           = backup-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backup_use_same_host           = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backup_use_temp_snapshot       = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] chap_password                  = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] chap_username                  =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_internal_tenant_project_id = 290d472a8b424a8e96d7834eca60efba {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_internal_tenant_user_id = bb02730f02b84012bdb1da17df34ffb1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cluster                        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] compression_format             = gzip {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] config_dir                     = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] config_source                  = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] control_exchange               = openstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] debug                          = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] default_availability_zone      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] default_group_type             = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] default_volume_type            = QuobyteHD {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] disk_geometry                  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_client_cert             = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_client_cert_key         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_data_namespace          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_ssl_cert_path           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_ssl_cert_verify         = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] driver_use_ssl                 = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] enable_new_services            = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] enable_unsupported_driver      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] enforce_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] filter_function                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_api_insecure            = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_api_servers             = ['http://192.168.122.165/image'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_api_ssl_compression     = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_ca_certificates_file    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_certfile                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_keyfile                 = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_num_retries             = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance_request_timeout         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] goodness_function              = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] graceful_shutdown_timeout      = 5 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] group_api_class                = cinder.group.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] host                           = devstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_compress_on_upload       = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_conversion_address_space_limit = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_conversion_cpu_limit     = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_conversion_disable       = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_upload_use_cinder_backend = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_upload_use_internal_tenant = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_volume_cache_enabled     = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_volume_cache_max_count   = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] image_volume_cache_max_size_gb = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] init_host_max_objects_retrieval = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iscsi_target_flags             =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iscsi_write_cache              = on {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iser_helper                    = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[82279]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iser_ip_address                = 192.168.122.165 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iser_port                      = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_color                      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_config_append              = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_dir                        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_file                       = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_options                    = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_rotate_interval            = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_rotate_interval_type       = days {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] log_rotation_type              = none {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] max_age                        = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] max_logfile_count              = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[82279]: INFO cinder.volume.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.remotefs [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82279) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] max_logfile_size_mb            = 200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] max_over_subscription_ratio    = 20.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] message_reap_interval          = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] message_ttl                    = 2592000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] migration_create_volume_timeout_secs = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] monkey_patch                   = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] monkey_patch_modules           = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] my_ip                          = 192.168.122.165 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] no_snapshot_gb_quota           = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] num_iser_scan_tries            = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] num_shell_tries                = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] num_volume_device_scan_tries   = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] nvmeof_conn_info_version       = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] nvmet_ns_id                    = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] nvmet_port_id                  = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_max_limit                = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_ext_list          = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_listen_port       = 8776 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_use_ssl           = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] osapi_volume_workers           = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] per_volume_size_limit          = -1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] periodic_fuzzy_delay           = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] periodic_interval              = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] public_endpoint                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] publish_errors                 = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_backup_gigabytes         = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_backups                  = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_gigabytes                = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_groups                   = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_snapshots                = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] quota_volumes                  = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] rate_limit_burst               = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] rate_limit_except_level        = CRITICAL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] rate_limit_interval            = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] reinit_driver_count            = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] replication_device             = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] report_discard_supported       = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] report_interval                = 120 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] reservation_clean_interval     = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] reservation_expire             = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] reserved_image_namespaces      = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] reserved_percentage            = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] rpc_response_timeout           = 120 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] run_external_periodic_tasks    = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] scst_target_driver             = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] scst_target_iqn_name           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_down_time              = 720 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] shell_completion               = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] snapshot_name_template         = snapshot-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] split_loggers                  = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] state_path                     = /opt/stack/data/cinder {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] storage_availability_zone      = nova {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] storage_protocol               = iSCSI {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] syslog_log_facility            = LOG_USER {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_helper                  = lioadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_ip_address              = 192.168.122.165 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_port                    = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_protocol                = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] target_secondary_ip_addresses  = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] trace_flags                    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] transport_url                  = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] until_refresh                  = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_chap_auth                  = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_default_quota_class        = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_journal                    = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_json                       = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_multipath_for_image_xfer   = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_stderr                     = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] use_syslog                     = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] verify_glance_signatures       = enabled {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_api_class               = cinder.volume.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_backend_name            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_clear                   = zero {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_clear_ionice            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_clear_size              = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_copy_bps_limit          = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_dd_blocksize            = 1M {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_name_template           = volume-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_service_inithost_offload = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volume_usage_audit_period      = month {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82279) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 08 11:01:18 devstack cinder-volume[82279]: WARNING cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 08 11:01:18 devstack cinder-volume[82279]: WARNING cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Running cmd (subprocess): mount.quobyte {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] zoning_mode                    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_concurrency.disable_process_locking = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.admin_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.admin_token = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.admin_user  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_protocol = https {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_type   = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_uri    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.auth_version = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.cache       = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.certfile    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.identity_uri = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.include_service_catalog = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.insecure    = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.interface   = public {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.keyfile     = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_password =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcache_username =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.region_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.service_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.backend                  = dogpile.cache.null {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.backend_argument         = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.backend_expiration_time  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.config_prefix            = cache.oslo {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.debug_cache_backend      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.enable_retry_client      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.enable_socket_keepalive  = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.enabled                  = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.enforce_fips_mode        = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.expiration_time          = 600 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.hashclient_retry_attempts = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_dead_retry      = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_sasl_enabled    = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.password                 = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.proxies                  = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.redis_db                 = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.redis_server             = localhost:6379 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.retry_attempts           = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.retry_delay              = 0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.socket_keepalive_count   = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.socket_keepalive_idle    = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.socket_keepalive_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.socket_timeout           = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.tls_allowed_ciphers      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.tls_cafile               = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.tls_certfile             = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.tls_enabled              = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.tls_keyfile              = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cache.username                 = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] coordination.backend_url       = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.asyncio_connection    = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.asyncio_slave_connection = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.backend               = sqlalchemy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.connection            = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.connection_debug      = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.connection_parameters =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.connection_recycle_time = 3600 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.connection_trace      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.db_inc_retry_interval = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.db_max_retries        = 20 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.db_max_retry_interval = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.db_retry_interval     = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.max_overflow          = 50 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.max_pool_size         = 5 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.max_retries           = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.mysql_wsrep_sync_wait = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.pool_timeout          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.retry_interval        = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.slave_connection      = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.sqlite_synchronous    = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.synchronous_reader    = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] database.use_db_reconnect      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack quobyte-client[82280]: Reading configuration file: /etc/quobyte/client.cfg
Apr 08 11:01:18 devstack quobyte-client[82280]: Invalid parameters found, error: missing mount point.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack quobyte-client[82280]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 08 11:01:18 devstack quobyte-client[82280]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.connection_string     = messaging:// {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.enabled               = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.es_doc_type           = notification {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.es_scroll_size        = 10000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.es_scroll_time        = 2m {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.filter_error_trace    = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.hmac_keys             = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.sentinel_service_name = mymaster {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.socket_timeout        = 0.1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.trace_requests        = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler.trace_sqlalchemy      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler_jaeger.process_tags   = {} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler_jaeger.service_name_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] profiler_otlp.service_name_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.enforce_new_defaults = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: WARNING oslo_config.cfg [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.enforce_scope      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.policy_default_rule = default {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:18 devstack cinder-volume[82279]: INFO cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd ...
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d -c /etc/quobyte/client-cinder.cfg {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.group          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.helper_command = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] privsep_osbrick.user           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.group         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.helper_command = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] cinder_sys_admin.user          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.auth_section      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.auth_type         = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.cafile            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.certfile          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.collect_timing    = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.insecure          = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.keyfile           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.send_service_user_token = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.split_loggers     = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] service_user.timeout           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.auth_section            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.auth_type               = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.certfile                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.collect_timing          = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.insecure                = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.keyfile                 = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.region_name             = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.split_loggers           = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] glance.timeout                 = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.backend_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.chap_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.chap_username =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.disk_geometry = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_client_cert = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_client_cert_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_data_namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.driver_use_ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.extra_capabilities = {} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.filter_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.goodness_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iscsi_target_flags =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iscsi_write_cache = on {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iser_port     = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_host      =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_login     = admin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_mount_options = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack sudo[82281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d -c /etc/quobyte/client-cinder.cfg
Apr 08 11:01:18 devstack sudo[82281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_password  = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_private_key =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_share_path =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.num_shell_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.quobyte_volume_url = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.replication_device = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.report_discard_supported = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.reserved_percentage = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_helper = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_port   = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_protocol = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.trace_flags   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.unique_fqdn_network = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.use_chap_auth = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_backend_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_clear  = zero {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_clear_ionice = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_clear_size = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_reports.file_event_handler = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_reports.log_dir           = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.backend_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.backend_host         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.chap_password        = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.chap_username        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.disk_geometry        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_client_cert   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_data_namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.extra_capabilities   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.filter_function      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.goodness_function    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iser_helper          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iser_ip_address      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iser_port            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_host             = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_login            = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_mount_options    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_password         = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_private_key      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_share_path       = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.num_shell_tries      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.replication_device   = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.report_discard_supported = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.reserved_percentage  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.scst_target_driver   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.storage_protocol     = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_helper        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_ip_address    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_port          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_prefix        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_protocol      = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.trace_flags          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.use_chap_auth        = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_clear         = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_clear_size    = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] QuobyteHD.volumes_dir          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_notifications.driver = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_notifications.retry = -1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] key_manager.fixed_key          = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.barbican_api_version  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.barbican_endpoint     = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.barbican_endpoint_type = public {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.barbican_region_name  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.cafile                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.certfile              = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.collect_timing        = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.insecure              = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.keyfile               = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.number_of_retries     = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.retry_delay           = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.send_service_user_token = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.split_loggers         = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.timeout               = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.verify_ssl            = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican.verify_ssl_path       = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.auth_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.cafile   = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.collect_timing = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.keyfile  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] barbican_service_user.timeout  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.approle_role_id          = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.approle_secret_id        = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.kv_mountpoint            = secret {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.kv_path                  = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.kv_version               = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.namespace                = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.root_token_id            = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.ssl_ca_crt_file          = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.timeout                  = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.use_ssl                  = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:18 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] ******************************************************************************** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 08 11:01:19 devstack sudo[82281]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.580s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:19 devstack cinder-volume[82279]: INFO cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd succeeded
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.604s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:19 devstack sudo[82351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:19 devstack sudo[82351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:19 devstack sudo[82351]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.396s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:19 devstack cinder-volume[82279]: INFO cinder.volume.driver [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Driver hasn't implemented _init_vendor_properties()
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.volume.driver [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82279) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_db.sqlalchemy.engines [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG dbcounter [-] [82279] Writer thread running {{(pid=82279) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.db.sqlalchemy.api [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Building query based on filter {{(pid=82279) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.image.image_utils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82279) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 08 11:01:19 devstack cinder-volume[82279]: INFO cinder.keymgr.migration [None req-da4466a9-3be6-4479-95d2-e47f077c38b1 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:19 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:19 devstack sudo[82354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:19 devstack sudo[82354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:20 devstack sudo[82354]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.394s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG cinder.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Notifying Schedulers of capabilities ... {{(pid=82279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:01:20 devstack cinder-volume[82279]: INFO cinder.volume.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Driver initialization completed successfully.
Apr 08 11:01:20 devstack cinder-volume[82279]: INFO cinder.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Initiating service 3 cleanup
Apr 08 11:01:20 devstack cinder-volume[82279]: INFO cinder.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Service 3 cleanup completed.
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG cinder.service [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Creating RPC server for service cinder-volume {{(pid=82279) start /opt/stack/cinder/cinder/service.py:231}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG cinder.service [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82279) start /opt/stack/cinder/cinder/service.py:237}}
Apr 08 11:01:20 devstack cinder-volume[82279]: INFO cinder.volume.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:20 devstack sudo[82364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:20 devstack sudo[82364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:20 devstack sudo[82364]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:20 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.482s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:20 devstack cinder-volume[82279]: INFO cinder.volume.manager [None req-20f653a9-5af7-495e-84b2-7788e51c0e95 None None] Driver post RPC initialization completed successfully.
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82279) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG cinder.volume.drivers.quobyte [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82279) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82279) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:23 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:23 devstack sudo[82447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:23 devstack sudo[82447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:24 devstack sudo[82447]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:24 devstack cinder-volume[82279]: DEBUG oslo_concurrency.processutils [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.407s {{(pid=82279) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:24 devstack cinder-volume[82279]: DEBUG cinder.manager [None req-92893e7a-860e-47fa-916f-ba3c4f287c98 None None] Notifying Schedulers of capabilities ... {{(pid=82279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:01:27 devstack cinder-volume[81722]: INFO oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Caught SIGTERM, stopping children
Apr 08 11:01:27 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Acquiring lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:27 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Acquired lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:27 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Releasing lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:27 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Stop services. {{(pid=81722) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 08 11:01:27 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Killing children. {{(pid=81722) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 08 11:01:27 devstack cinder-volume[81722]: INFO oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Waiting on 1 children to exit
Apr 08 11:01:28 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Acquiring lock "singleton_lock" {{(pid=82279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:28 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Acquired lock "singleton_lock" {{(pid=82279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:28 devstack cinder-volume[82279]: DEBUG oslo_concurrency.lockutils [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Releasing lock "singleton_lock" {{(pid=82279) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:28 devstack cinder-volume[82279]: WARNING amqp [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 08 11:01:28 devstack cinder-volume[82279]: WARNING amqp [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 08 11:01:28 devstack cinder-volume[81722]: INFO oslo_service.backend._eventlet.service [None req-e59607ec-4694-4d47-b76f-0b31ccf60d86 None None] Child 82279 exited with status 0
Apr 08 11:01:28 devstack cinder-volume[82523]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 08 11:01:28 devstack cinder-volume[82523]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 11:01:28 devstack cinder-volume[82523]: we strongly recommend against using it for new projects.
Apr 08 11:01:28 devstack cinder-volume[82523]: If you are already using Eventlet, we recommend migrating to a different
Apr 08 11:01:28 devstack cinder-volume[82523]: framework.  For more detail see
Apr 08 11:01:28 devstack cinder-volume[82523]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 11:01:28 devstack cinder-volume[82523]:   import eventlet  # noqa
Apr 08 11:01:30 devstack cinder-volume[82523]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 08 11:01:30 devstack cinder-volume[82523]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 08 11:01:30 devstack cinder-volume[82523]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82523) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 08 11:01:30 devstack cinder-volume[82523]: INFO dbcounter [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Registered counter for database cinder
Apr 08 11:01:30 devstack cinder-volume[82523]: DEBUG oslo_db.sqlalchemy.engines [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG dbcounter [-] [82523] Writer thread running {{(pid=82523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 11:01:31 devstack cinder-volume[82523]: INFO cinder.rpc [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 08 11:01:31 devstack cinder-volume[82523]: INFO cinder.rpc [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_db.sqlalchemy.engines [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:31 devstack cinder-volume[82523]: INFO cinder.volume.manager [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Determined volume DB was empty at startup.
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG cinder.volume.manager [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82523) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 08 11:01:31 devstack cinder-volume[82523]: WARNING stevedore.named [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 08 11:01:31 devstack cinder-volume[82523]: WARNING castellan.key_manager [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 11:01:31 devstack cinder-volume[82523]: WARNING cinder.keymgr.conf_key_mgr [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 08 11:01:31 devstack cinder-volume[82523]: INFO cinder.volume.manager [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_db.sqlalchemy.engines [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:31 devstack cinder-volume[82523]: INFO oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Starting 1 workers
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Started child 82670 {{(pid=82523) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Full set of CONF: {{(pid=82523) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] ******************************************************************************** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Configuration options gathered from: {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] ================================================================================ {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] allow_availability_zone_fallback = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] allow_compression_on_image_upload = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] allowed_direct_url_schemes     = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] api_rate_limit                 = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] auth_strategy                  = keystone {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_availability_zone      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_host                   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_name                   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_stats_polling_interval = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backup_api_class               = cinder.backup.api.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backup_name_template           = backup-%s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backup_use_same_host           = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backup_use_temp_snapshot       = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82670]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] chap_password                  = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] chap_username                  =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_internal_tenant_project_id = 290d472a8b424a8e96d7834eca60efba {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_internal_tenant_user_id = bb02730f02b84012bdb1da17df34ffb1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cluster                        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] compression_format             = gzip {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] config_dir                     = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] config_source                  = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] control_exchange               = openstack {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] debug                          = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] default_availability_zone      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] default_group_type             = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] default_volume_type            = QuobyteHD {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] disk_geometry                  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_client_cert             = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_client_cert_key         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_data_namespace          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_ssl_cert_path           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_ssl_cert_verify         = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] driver_use_ssl                 = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] enable_new_services            = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] enable_unsupported_driver      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] enforce_multipath_for_image_xfer = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] filter_function                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_api_insecure            = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_api_servers             = ['http://192.168.122.165/image'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_api_ssl_compression     = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_ca_certificates_file    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_certfile                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_keyfile                 = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_num_retries             = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance_request_timeout         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] goodness_function              = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] graceful_shutdown_timeout      = 5 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] group_api_class                = cinder.group.api.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] host                           = devstack {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_compress_on_upload       = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_conversion_address_space_limit = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_conversion_cpu_limit     = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_conversion_disable       = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_upload_use_cinder_backend = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_upload_use_internal_tenant = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_volume_cache_enabled     = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_volume_cache_max_count   = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] image_volume_cache_max_size_gb = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] init_host_max_objects_retrieval = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iscsi_target_flags             =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iscsi_write_cache              = on {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iser_helper                    = tgtadm {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iser_ip_address                = 192.168.122.165 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iser_port                      = 3260 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_color                      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_config_append              = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_dir                        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_file                       = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_options                    = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_rotate_interval            = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_rotate_interval_type       = days {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] log_rotation_type              = none {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] max_age                        = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] max_logfile_count              = 30 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] max_logfile_size_mb            = 200 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] max_over_subscription_ratio    = 20.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] message_reap_interval          = 86400 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] message_ttl                    = 2592000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] migration_create_volume_timeout_secs = 300 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] monkey_patch                   = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] monkey_patch_modules           = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] my_ip                          = 192.168.122.165 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] no_snapshot_gb_quota           = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82670) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] num_iser_scan_tries            = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] num_shell_tries                = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] num_volume_device_scan_tries   = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] nvmeof_conn_info_version       = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] nvmet_ns_id                    = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] nvmet_port_id                  = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_max_limit                = 1000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_ext_list          = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_listen_port       = 8776 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_use_ssl           = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] osapi_volume_workers           = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] per_volume_size_limit          = -1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] periodic_fuzzy_delay           = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] periodic_interval              = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] public_endpoint                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] publish_errors                 = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_backup_gigabytes         = 1000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_backups                  = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_gigabytes                = 1000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_groups                   = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_snapshots                = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] quota_volumes                  = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] rate_limit_burst               = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] rate_limit_except_level        = CRITICAL {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] rate_limit_interval            = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] reinit_driver_count            = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] replication_device             = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] report_discard_supported       = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] report_interval                = 120 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] reservation_clean_interval     = 86400 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] reservation_expire             = 86400 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] reserved_image_namespaces      = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] reserved_percentage            = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] rpc_response_timeout           = 120 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] run_external_periodic_tasks    = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] scst_target_driver             = iscsi {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] scst_target_iqn_name           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_down_time              = 720 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] shell_completion               = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] snapshot_name_template         = snapshot-%s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] split_loggers                  = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] state_path                     = /opt/stack/data/cinder {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] storage_availability_zone      = nova {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] storage_protocol               = iSCSI {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] syslog_log_facility            = LOG_USER {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_helper                  = lioadm {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_ip_address              = 192.168.122.165 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_port                    = 3260 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_protocol                = iscsi {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] target_secondary_ip_addresses  = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] trace_flags                    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] transport_url                  = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] until_refresh                  = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_chap_auth                  = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_default_quota_class        = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_journal                    = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_json                       = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_multipath_for_image_xfer   = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_stderr                     = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] use_syslog                     = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] verify_glance_signatures       = enabled {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_api_class               = cinder.volume.api.API {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_backend_name            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_clear                   = zero {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_clear_ionice            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_clear_size              = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_copy_bps_limit          = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_dd_blocksize            = 1M {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_name_template           = volume-%s {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_service_inithost_offload = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volume_usage_audit_period      = month {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] zoning_mode                    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_concurrency.disable_process_locking = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.admin_password = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.admin_token = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.admin_user  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_protocol = https {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_section = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_type   = password {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_uri    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.auth_version = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.cache       = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.certfile    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.identity_uri = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.include_service_catalog = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.insecure    = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.interface   = public {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.keyfile     = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_password =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcache_username =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.region_name = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.service_type = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.165/identity {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.backend                  = dogpile.cache.null {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.backend_argument         = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.backend_expiration_time  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.config_prefix            = cache.oslo {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.debug_cache_backend      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.enable_retry_client      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.enable_socket_keepalive  = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.enabled                  = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.enforce_fips_mode        = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.expiration_time          = 600 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.hashclient_retry_attempts = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_dead_retry      = 300 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_sasl_enabled    = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.password                 = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.proxies                  = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.redis_db                 = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.redis_server             = localhost:6379 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.retry_attempts           = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.retry_delay              = 0.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.socket_keepalive_count   = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.socket_keepalive_idle    = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.socket_keepalive_interval = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.socket_timeout           = 1.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.tls_allowed_ciphers      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.tls_cafile               = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.tls_certfile             = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.tls_enabled              = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.tls_keyfile              = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cache.username                 = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] coordination.backend_url       = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.asyncio_connection    = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.asyncio_slave_connection = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.backend               = sqlalchemy {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.connection            = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.connection_debug      = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.connection_parameters =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.connection_recycle_time = 3600 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.connection_trace      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.db_inc_retry_interval = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.db_max_retries        = 20 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.db_max_retry_interval = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.db_retry_interval     = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.max_overflow          = 50 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.max_pool_size         = 5 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.max_retries           = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.mysql_wsrep_sync_wait = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.pool_timeout          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.retry_interval        = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.slave_connection      = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.sqlite_synchronous    = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.synchronous_reader    = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] database.use_db_reconnect      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.connection_string     = messaging:// {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.enabled               = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.es_doc_type           = notification {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.es_scroll_size        = 10000 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.es_scroll_time        = 2m {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.filter_error_trace    = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.hmac_keys             = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.sentinel_service_name = mymaster {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.socket_timeout        = 0.1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.trace_requests        = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler.trace_sqlalchemy      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler_jaeger.process_tags   = {} {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler_jaeger.service_name_prefix = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] profiler_otlp.service_name_prefix = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82670) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 08 11:01:31 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 08 11:01:31 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Running cmd (subprocess): mount.quobyte {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.enforce_new_defaults = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: WARNING oslo_config.cfg [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.enforce_scope      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.policy_default_rule = default {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.group          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.helper_command = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] privsep_osbrick.user           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.group         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.helper_command = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] cinder_sys_admin.user          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.auth_section      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.auth_type         = password {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.cafile            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.certfile          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.collect_timing    = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.insecure          = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.keyfile           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.send_service_user_token = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.split_loggers     = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] service_user.timeout           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.auth_section            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.auth_type               = password {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.certfile                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.collect_timing          = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.insecure                = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.keyfile                 = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.region_name             = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.split_loggers           = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] glance.timeout                 = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.backend_availability_zone = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.chap_password = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.chap_username =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.disk_geometry = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_client_cert = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_client_cert_key = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_data_namespace = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.driver_use_ssl = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.extra_capabilities = {} {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.filter_function = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.goodness_function = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iscsi_target_flags =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iscsi_write_cache = on {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iser_ip_address = 192.168.122.165 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iser_port     = 3260 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_host      =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_login     = admin {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_mount_options = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_password  = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_private_key =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_share_path =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.num_shell_tries = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.quobyte_volume_url = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.replication_device = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.report_discard_supported = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.reserved_percentage = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_helper = tgtadm {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_ip_address = 192.168.122.165 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_port   = 3260 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_protocol = iscsi {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.trace_flags   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.unique_fqdn_network = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.use_chap_auth = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_backend_name = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_clear  = zero {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_clear_ionice = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_clear_size = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_reports.file_event_handler = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_reports.log_dir           = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.backend_availability_zone = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack quobyte-client[82676]: Reading configuration file: /etc/quobyte/client.cfg
Apr 08 11:01:31 devstack quobyte-client[82676]: Invalid parameters found, error: missing mount point.
Apr 08 11:01:31 devstack quobyte-client[82676]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 08 11:01:31 devstack quobyte-client[82676]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.backend_host         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.chap_password        = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.chap_username        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.disk_geometry        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_client_cert   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_data_namespace = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.extra_capabilities   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.filter_function      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.goodness_function    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iser_helper          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iser_ip_address      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iser_port            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_host             = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_login            = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_mount_options    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_password         = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_private_key      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_share_path       = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.num_shell_tries      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.replication_device   = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.report_discard_supported = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.reserved_percentage  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.scst_target_driver   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.storage_protocol     = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_helper        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_ip_address    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_port          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_prefix        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_protocol      = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.trace_flags          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.use_chap_auth        = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_clear         = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_clear_size    = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack sudo[82684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack sudo[82684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] QuobyteHD.volumes_dir          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_notifications.driver = [] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_notifications.retry = -1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] key_manager.fixed_key          = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.barbican_api_version  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.barbican_endpoint     = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.barbican_endpoint_type = public {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.barbican_region_name  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.cafile                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.certfile              = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.collect_timing        = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.insecure              = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.keyfile               = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.number_of_retries     = 60 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.retry_delay           = 1 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.send_service_user_token = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.split_loggers         = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.timeout               = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.verify_ssl            = True {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican.verify_ssl_path       = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.auth_section = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.auth_type = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.cafile   = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.certfile = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.collect_timing = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.insecure = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.keyfile  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.split_loggers = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] barbican_service_user.timeout  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.approle_role_id          = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.approle_secret_id        = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.kv_mountpoint            = secret {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.kv_path                  = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.kv_version               = 2 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.namespace                = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.root_token_id            = **** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.ssl_ca_crt_file          = None {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.timeout                  = 60.0 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.use_ssl                  = False {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 08 11:01:31 devstack cinder-volume[82523]: DEBUG oslo_service.backend._eventlet.service [None req-c58c052a-3d19-4e07-ac80-67aa038b0ae2 None None] ******************************************************************************** {{(pid=82523) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 08 11:01:32 devstack sudo[82684]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.782s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:32 devstack cinder-volume[82670]: INFO cinder.volume.driver [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Driver hasn't implemented _init_vendor_properties()
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG cinder.volume.driver [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82670) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_db.sqlalchemy.engines [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82670) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writer thread running {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG cinder.db.sqlalchemy.api [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Building query based on filter {{(pid=82670) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82670) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:32 devstack cinder-volume[82670]: INFO cinder.keymgr.migration [None req-690b1bad-ab07-4b44-acc4-722bebecadfe None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 08 11:01:32 devstack sudo[82761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:32 devstack sudo[82761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:33 devstack sudo[82761]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.550s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:01:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Driver initialization completed successfully.
Apr 08 11:01:33 devstack cinder-volume[82670]: INFO cinder.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Initiating service 3 cleanup
Apr 08 11:01:33 devstack cinder-volume[82670]: INFO cinder.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Service 3 cleanup completed.
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG cinder.service [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Creating RPC server for service cinder-volume {{(pid=82670) start /opt/stack/cinder/cinder/service.py:231}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG cinder.service [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82670) start /opt/stack/cinder/cinder/service.py:237}}
Apr 08 11:01:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:01:33 devstack sudo[82777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:01:33 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:01:33 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root
Apr 08 11:01:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:01:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eccb3404-7e2c-4895-bb55-d2d0d7109c0c None None] Driver post RPC initialization completed successfully.
Apr 08 11:01:41 devstack cinder-volume[82523]: DEBUG dbcounter [-] [82523] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82523) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:01:42 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=1 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:01:43 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:02:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-977d4775-ffb8-4b76-bf07-eef9abb0ca3e tempest-GroupsV314Test-833046745 None] Group tempest-GroupsV314Test-Group-181240079: creating
Apr 08 11:02:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-977d4775-ffb8-4b76-bf07-eef9abb0ca3e tempest-GroupsV314Test-833046745 None] Group tempest-GroupsV314Test-Group-181240079: created successfully
Apr 08 11:02:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-977d4775-ffb8-4b76-bf07-eef9abb0ca3e tempest-GroupsV314Test-833046745 None] Create group completed successfully.
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Flow 'volume_create_manager' (0fad584f-925c-4e98-a995-4463cad1a5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e0798e-1aba-4e63-9d9e-ed5350a03dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e0798e-1aba-4e63-9d9e-ed5350a03dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-359599949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265214d8533547c59522ea02368384be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:34Z,use_quota=True,user_id='c584c8ae8a8c43d19872d86df4ce9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4efb6e-67e2-41dd-a0f7-627211f37bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4efb6e-67e2-41dd-a0f7-627211f37bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efca70d-7601-4c63-8b65-141a7cd73c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efca70d-7601-4c63-8b65-141a7cd73c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120', 'volume_name': 'volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b5213c-3e03-4994-bb8c-3f21dbf9fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b5213c-3e03-4994-bb8c-3f21dbf9fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0af5c3b-ff38-4127-a2f6-55329174674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:33 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Volume 54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120', 'volume_size': 1}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-359599949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265214d8533547c59522ea02368384be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:34Z,use_quota=True,user_id='c584c8ae8a8c43d19872d86df4ce9933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Creating volume 54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:02:34 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:34 devstack sudo[83191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 1073741824
Apr 08 11:02:34 devstack sudo[83191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:34 devstack sudo[83191]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 1073741824" returned: 0 in 0.696s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:34 devstack sudo[83510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120
Apr 08 11:02:34 devstack sudo[83510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Flow 'volume_create_manager' (891043a1-869e-4187-b32b-5b040c997b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb65903-9d26-4d33-b60e-a88096e4b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb65903-9d26-4d33-b60e-a88096e4b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-917975395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7554b53-6ebe-423c-9dcb-8360f5457305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cffdc0b477e454584cf03083fa096f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:35Z,use_quota=True,user_id='9e1e377ecfda4662a9d1d598d923ee40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502169cc-4cf3-4ec1-b98d-72e2b2986d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502169cc-4cf3-4ec1-b98d-72e2b2986d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1987f356-4eca-4a8d-8a6c-2185a2d0c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1987f356-4eca-4a8d-8a6c-2185a2d0c20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7554b53-6ebe-423c-9dcb-8360f5457305', 'volume_name': 'volume-c7554b53-6ebe-423c-9dcb-8360f5457305', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab7ddb-246a-4ed3-a668-5812237c88f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ab7ddb-246a-4ed3-a668-5812237c88f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41750c25-f35e-4d51-ad66-ccc92270a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Volume c7554b53-6ebe-423c-9dcb-8360f5457305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7554b53-6ebe-423c-9dcb-8360f5457305', 'volume_size': 1}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Flow 'volume_create_manager' (adeb68d5-91c1-4688-bb78-c1a75599228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4fad16-9e8a-43a8-8c5f-8a69af3e3920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack sudo[83510]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4fad16-9e8a-43a8-8c5f-8a69af3e3920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166943483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e69adbab-1396-4473-83fa-6cc3c1b96f0e,host='devstack@QuobyteHD#QuobyteHD',id=6d5a9019-d776-4127-a6bb-e0b6b66d7ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729f72ea711d4058a06d7a4239d48966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:36Z,use_quota=True,user_id='fdbbfa6aaba04c6e88ff2c3e832c8994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e493c4ee-818d-41ca-9afb-8bf3e12409f4),volume_type_id=e493c4ee-818d-41ca-9afb-8bf3e12409f4)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d0e66e-41a2-4472-af96-abe46a6e997c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d0e66e-41a2-4472-af96-abe46a6e997c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15670a78-17a3-4dd4-b055-5c354abe4c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15670a78-17a3-4dd4-b055-5c354abe4c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5a9019-d776-4127-a6bb-e0b6b66d7ad4', 'volume_name': 'volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7852bc3-b8e3-4625-9d34-29d11bd0ab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7852bc3-b8e3-4625-9d34-29d11bd0ab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860c8ac1-147f-4aab-a70f-04e633e52bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Volume 6d5a9019-d776-4127-a6bb-e0b6b66d7ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4', 'volume_size': 1}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" returned: 0 in 0.981s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-917975395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7554b53-6ebe-423c-9dcb-8360f5457305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cffdc0b477e454584cf03083fa096f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:35Z,use_quota=True,user_id='9e1e377ecfda4662a9d1d598d923ee40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Creating volume c7554b53-6ebe-423c-9dcb-8360f5457305 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:02:35 devstack sudo[83514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 1073741824
Apr 08 11:02:35 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Flow 'volume_create_manager' (af7f1f60-b9d9-49f8-ad61-5ecd70135a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3956f5b-d643-4713-bcfd-13b922b2ff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3956f5b-d643-4713-bcfd-13b922b2ff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1028499099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a874761a2b2b4e0cad0c34e1a1d3527d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:36Z,use_quota=True,user_id='a70f3c503fff431cadb044e33a00002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47a74d-3798-4479-bf8d-7a53f68a769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d47a74d-3798-4479-bf8d-7a53f68a769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25cfae-b674-4e14-a532-5d5acaee630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd25cfae-b674-4e14-a532-5d5acaee630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786', 'volume_name': 'volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74797f3-fa50-4eeb-82bb-34be270d501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74797f3-fa50-4eeb-82bb-34be270d501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959cf8ba-79f6-4927-83e5-65326529ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Volume bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786', 'volume_size': 1}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0af5c3b-ff38-4127-a2f6-55329174674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ab0f04-c603-40e4-a093-b9822b0e3e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Volume volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 (54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120): created successfully
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ab0f04-c603-40e4-a093-b9822b0e3e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Flow 'volume_create_manager' (0fad584f-925c-4e98-a995-4463cad1a5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-c0b4623c-4ecc-40ed-9a4d-567cea2e350f req-df5c9799-c41c-4de9-ad99-627005240abc tempest-VolumesSnapshotsTestJSON-809537379 None] Created volume successfully.
Apr 08 11:02:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:36 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 1073741824" returned: 0 in 0.870s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:36 devstack sudo[83554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305
Apr 08 11:02:36 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:37 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305" returned: 0 in 0.512s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e69adbab-1396-4473-83fa-6cc3c1b96f0e,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1166943483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e69adbab-1396-4473-83fa-6cc3c1b96f0e,host='devstack@QuobyteHD#QuobyteHD',id=6d5a9019-d776-4127-a6bb-e0b6b66d7ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='729f72ea711d4058a06d7a4239d48966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:36Z,use_quota=True,user_id='fdbbfa6aaba04c6e88ff2c3e832c8994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e493c4ee-818d-41ca-9afb-8bf3e12409f4),volume_type_id=e493c4ee-818d-41ca-9afb-8bf3e12409f4)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Creating volume 6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:02:37 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41750c25-f35e-4d51-ad66-ccc92270a33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7554b53-6ebe-423c-9dcb-8360f5457305', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d229246-aa6b-461e-a29f-5f601bfccda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:37 devstack sudo[83558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 1073741824
Apr 08 11:02:37 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:37 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Volume volume-c7554b53-6ebe-423c-9dcb-8360f5457305 (c7554b53-6ebe-423c-9dcb-8360f5457305): created successfully
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d229246-aa6b-461e-a29f-5f601bfccda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Flow 'volume_create_manager' (891043a1-869e-4187-b32b-5b040c997b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8b435472-745f-46dc-a366-8ee1c8678f43 tempest-VolumesAdminNegativeTest-851183369 None] Created volume successfully.
Apr 08 11:02:37 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 1073741824" returned: 0 in 0.465s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:37 devstack sudo[83563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:37 devstack sudo[83563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:38 devstack sudo[83563]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1028499099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a874761a2b2b4e0cad0c34e1a1d3527d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:36Z,use_quota=True,user_id='a70f3c503fff431cadb044e33a00002f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Creating volume bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:02:38 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:38 devstack sudo[83566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 1073741824
Apr 08 11:02:38 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860c8ac1-147f-4aab-a70f-04e633e52bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0416621d-b2ad-4dc3-b187-eefb091f19f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:38 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Volume volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 (6d5a9019-d776-4127-a6bb-e0b6b66d7ad4): created successfully
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0416621d-b2ad-4dc3-b187-eefb091f19f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Flow 'volume_create_manager' (adeb68d5-91c1-4688-bb78-c1a75599228e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a8930328-1001-49f8-a682-2f8c8cdd1f65 tempest-GroupsV314Test-833046745 None] Created volume successfully.
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Acquiring lock "cinder-c7554b53-6ebe-423c-9dcb-8360f5457305-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "cinder-c7554b53-6ebe-423c-9dcb-8360f5457305-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Acquiring lock "cinder-quobyte-c7554b53-6ebe-423c-9dcb-8360f5457305" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "cinder-quobyte-c7554b53-6ebe-423c-9dcb-8360f5457305" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:38 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi3_5sx10/privsep.sock']
Apr 08 11:02:38 devstack sudo[83568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi3_5sx10/privsep.sock
Apr 08 11:02:38 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:38 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 1073741824" returned: 0 in 0.657s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:38 devstack sudo[83573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786
Apr 08 11:02:38 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 08 11:02:38 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 08 11:02:39 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" returned: 0 in 0.499s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.809s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Creating offline snapshot c932f90c-1159-45d2-881c-3cbc2963e592 of volume 54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959cf8ba-79f6-4927-83e5-65326529ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a579a156-94ce-47d8-b89b-7e7226cdb1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Volume volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 (bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786): created successfully
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a579a156-94ce-47d8-b89b-7e7226cdb1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Flow 'volume_create_manager' (af7f1f60-b9d9-49f8-ad61-5ecd70135a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-433697a7-9c4a-4cb1-a3a5-faa492109c6d tempest-DeleteServersTestJSON-846669951 None] Created volume successfully.
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 08 11:02:39 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Spawned new privsep daemon via rootwrap
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Accepted privsep connection to /tmp/tmpi3_5sx10/privsep.sock {{(pid=82670) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 08 11:02:39 devstack cinder-volume[82670]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83578
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62731950-6ee5-488a-8c31-688eda1d9ada]: (2,) {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:39 devstack cinder-volume[82670]: WARNING oslo_privsep.priv_context [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] privsep daemon already running
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec440d0-805e-4270-bc21-d945eb075fa2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1e9c08-c0a9-4eef-9b60-9d1bc5fc2c9d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:40 devstack sudo[83581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305
Apr 08 11:02:40 devstack sudo[83581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:40 devstack sudo[83582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120
Apr 08 11:02:40 devstack sudo[83582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:40 devstack sudo[83582]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" returned: 0 in 0.712s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:40 devstack sudo[83598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 1G
Apr 08 11:02:40 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:40 devstack sudo[83581]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305" returned: 0 in 0.805s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:40 devstack sudo[83600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305
Apr 08 11:02:40 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:41 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c7554b53-6ebe-423c-9dcb-8360f5457305" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "cinder-quobyte-c7554b53-6ebe-423c-9dcb-8360f5457305" released by "delete_volume" :: held 2.644s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:41 devstack cinder-volume[82670]: WARNING cinder.quota [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:02:41 devstack cinder-volume[82670]: WARNING cinder.quota [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Created reservations ['f39eba44-d5a0-45a1-ad64-df3ba1ff36ef', '099da115-93de-4169-9bd4-1211c4d5c279', '864f5500-cff3-4650-b6c2-773d8e29998a', '2606b09f-0dc2-4ff1-8a4f-e07cfd434bcf'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:41 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 1G" returned: 0 in 0.590s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:41 devstack sudo[83607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592
Apr 08 11:02:41 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:41 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:02:41 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:41 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592" returned: 0 in 0.624s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:41 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 is being set with open permissions: ugo+rw
Apr 08 11:02:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:41 devstack sudo[83617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592
Apr 08 11:02:41 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:42 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.744s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:02:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Deleted volume successfully.
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3261c573-0558-4ce0-bfd9-6a6836ab0a40 tempest-VolumesAdminNegativeTest-851183369 None] Lock "cinder-c7554b53-6ebe-423c-9dcb-8360f5457305-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:42 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:42 devstack sudo[83623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info
Apr 08 11:02:42 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:42 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info" returned: 0 in 0.524s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:42 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info is being set with open permissions: ugo+rw
Apr 08 11:02:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:43 devstack sudo[83634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info
Apr 08 11:02:43 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:43 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.info" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.177s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.437s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:43 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Cloning volume 6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 to volume dc4f24df-b373-4c39-95a1-1e4738d11587
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Creating offline snapshot e605bd52-07c4-482c-b04b-aeca66240f1b of volume 6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:02:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-3f57f80c-4dc3-4fbf-adbf-763cec4fef2e req-6794a9d6-5372-4482-9d25-efb4c266214c tempest-VolumesSnapshotsTestJSON-809537379 None] Create snapshot completed successfully
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[948a6f97-80d9-4eae-9474-ac7c564a84f1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:43 devstack sudo[83660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:43 devstack sudo[83660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:44 devstack sudo[83660]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.480s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:44 devstack sudo[83666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b 1G
Apr 08 11:02:44 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "cinder-c932f90c-1159-45d2-881c-3cbc2963e592-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-c932f90c-1159-45d2-881c-3cbc2963e592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "cinder-quobyte-c932f90c-1159-45d2-881c-3cbc2963e592" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-c932f90c-1159-45d2-881c-3cbc2963e592" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Deleting offline snapshot c932f90c-1159-45d2-881c-3cbc2963e592 of volume 54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] snapshot_file for this snap is: volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb5934-d88f-4838-8a3e-d5402b516e95]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:44 devstack sudo[83670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592
Apr 08 11:02:44 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:44 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b 1G" returned: 0 in 0.676s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:44 devstack sudo[83678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:44 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:45 devstack cinder-volume[82670]: WARNING py.warnings [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 08 11:02:45 devstack cinder-volume[82670]:   .first()
Apr 08 11:02:45 devstack cinder-volume[82670]: 
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:45 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592" returned: 0 in 0.738s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2c934a-f8bb-43b6-a92b-7406ebd4d3ad]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:45 devstack sudo[83692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120
Apr 08 11:02:45 devstack sudo[83692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:45 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.555s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:45 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:45 devstack sudo[83698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:45 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:45 devstack sudo[83692]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:45 devstack sudo[83704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592
Apr 08 11:02:45 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:45 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:45 devstack sudo[83706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info
Apr 08 11:02:45 devstack sudo[83706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:46 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:46 devstack sudo[83712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592
Apr 08 11:02:46 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:46 devstack sudo[83706]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info" returned: 0 in 0.445s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:46 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:46 devstack sudo[83714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info
Apr 08 11:02:46 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:46 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120.c932f90c-1159-45d2-881c-3cbc2963e592" returned: 0 in 0.429s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-c932f90c-1159-45d2-881c-3cbc2963e592" released by "_delete_snapshot" :: held 2.223s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" released by "delete_snapshot" :: held 2.236s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:46 devstack cinder-volume[82670]: WARNING cinder.quota [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.quota [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Created reservations ['d21e7614-45f6-467d-a454-d7de8b46d253', '96d1f4a3-2441-4a58-a7fb-9ba042cb86ec', '90c6df01-7019-41c7-a7d3-50fa21b34d7d', 'f93fc836-1e9f-46b4-9508-ad406fc834ad'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:46 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.info" returned: 0 in 0.450s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Acquiring lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:46 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Delete snapshot completed successfully.
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-d18d54e9-7f67-44e6-bdda-fb4931192069 req-21d8d538-8ea1-4f83-930b-5a5ff9bf22fc tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-c932f90c-1159-45d2-881c-3cbc2963e592-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] snapshot: e605bd52-07c4-482c-b04b-aeca66240f1b, volume: dc4f24df-b373-4c39-95a1-1e4738d11587,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5849f-9d68-4ad7-b88e-3578cf61c6a1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:46 devstack sudo[83718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:46 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:47 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.519s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca44c464-f263-49ed-9f5b-4dd49817ee86]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:47 devstack sudo[83723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:47 devstack sudo[83723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "cinder-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a0851-66ed-448d-8e9c-bd1cadbebbb2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:47 devstack sudo[83725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120
Apr 08 11:02:47 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:47 devstack sudo[83723]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.546s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:02:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:47 devstack sudo[83730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587
Apr 08 11:02:47 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:48 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" returned: 0 in 0.478s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:48 devstack sudo[83735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120
Apr 08 11:02:48 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:49 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" returned: 0 in 0.772s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-quobyte-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120" released by "delete_volume" :: held 1.307s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG cinder.quota [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Created reservations ['5f65fa65-afc3-4ba2-b7a0-3e6d9430d6eb', '2220f951-3d53-4b7c-bac3-1789ec833f2c', '2a484658-8a85-4751-b4ac-358ead2f6aa3', '0a23561a-e36c-4ed9-8bcb-8f819efaaa2a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:49 devstack sudo[83763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:02:49 devstack sudo[83763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:50 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587" returned: 0 in 3.081s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d5f3b-7919-4419-b1be-9b9452ec3e81]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:51 devstack sudo[83767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:51 devstack sudo[83767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:51 devstack sudo[83763]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 1.696s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG cinder.manager [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:02:51 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Deleted volume successfully.
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-8406e67c-9eb4-42e9-9203-c4d7624df2d9 req-4dc3f88c-6b55-4c1a-9e58-6fd4fbcc535e tempest-VolumesSnapshotsTestJSON-809537379 None] Lock "cinder-54fd3ee5-9edd-4fcb-9dbb-46b4f9d98120-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:51 devstack sudo[83767]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.758s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4, size 1024.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:02:51 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Converted 1024.00 MB image at 332.26 MB/s
Apr 08 11:02:51 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:02:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:51 devstack sudo[83775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587
Apr 08 11:02:51 devstack sudo[83775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:52 devstack sudo[83775]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" released by "_copy_volume_from_snapshot" :: held 5.430s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Acquiring lock "cinder-quobyte-e605bd52-07c4-482c-b04b-aeca66240f1b" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-e605bd52-07c4-482c-b04b-aeca66240f1b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Deleting offline snapshot e605bd52-07c4-482c-b04b-aeca66240f1b of volume 6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] snapshot_file for this snap is: volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f1a8e-b421-4bd9-8a04-09462dee37c2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:52 devstack sudo[83778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:52 devstack sudo[83778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:52 devstack sudo[83778]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.745s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4a2e22-909c-4b14-9ce7-d6c7bd40b038]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:53 devstack sudo[83783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:53 devstack sudo[83783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Flow 'volume_create_manager' (6bcf0627-b005-4175-b317-ccf5f203a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baca4219-609d-4f0f-9a4d-d7a1e0a83215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baca4219-609d-4f0f-9a4d-d7a1e0a83215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-219389519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156e5ab-1a1f-469b-891b-3b23e987236c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36e00487e69243b1aa79f473641ed330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:54Z,use_quota=True,user_id='6cb17214013d4c1a8c7a872c703b3f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bf984a-cd32-4edc-9d93-76e095b96991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bf984a-cd32-4edc-9d93-76e095b96991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56067923-5fdd-4a93-b3af-8f18d1e1796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56067923-5fdd-4a93-b3af-8f18d1e1796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1156e5ab-1a1f-469b-891b-3b23e987236c', 'volume_name': 'volume-1156e5ab-1a1f-469b-891b-3b23e987236c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8de75-4d09-4de4-bc4c-5e59148057ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e8de75-4d09-4de4-bc4c-5e59148057ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a609224-1e46-4e1f-8a78-44d2ebf7f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Volume 1156e5ab-1a1f-469b-891b-3b23e987236c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1156e5ab-1a1f-469b-891b-3b23e987236c', 'volume_size': 1}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:53 devstack sudo[83783]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.667s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:53 devstack sudo[83796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:53 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:54 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.488s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:54 devstack sudo[83801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b
Apr 08 11:02:54 devstack sudo[83801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:54 devstack sudo[83801]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4.e605bd52-07c4-482c-b04b-aeca66240f1b" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-e605bd52-07c4-482c-b04b-aeca66240f1b" released by "_delete_snapshot" :: held 2.460s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.152s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.643s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be286b-6d8c-40f5-be55-1490e6992342]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5615d170-f3c3-4a71-bf22-1d9dde2e65ef tempest-GroupsV314Test-833046745 None] Create group from source-group-e69adbab-1396-4473-83fa-6cc3c1b96f0e completed successfully.
Apr 08 11:02:54 devstack sudo[83805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786
Apr 08 11:02:54 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:55 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" returned: 0 in 0.555s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.565s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-219389519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156e5ab-1a1f-469b-891b-3b23e987236c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36e00487e69243b1aa79f473641ed330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:02:54Z,use_quota=True,user_id='6cb17214013d4c1a8c7a872c703b3f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Creating volume 1156e5ab-1a1f-469b-891b-3b23e987236c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:02:55 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:55 devstack sudo[83829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c 1073741824
Apr 08 11:02:55 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd', 'name': 'volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22b80781-d0f9-4719-a219-0354ff20c706', 'enforce_multipath': True} {{(pid=82670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 08 11:02:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-0b4c902f-d42d-49e4-a8ed-0432cfb8675a req-ea08f7d8-7fec-4497-ba97-d86ad820890b tempest-DeleteServersTestJSON-846669951 None] attachment_update completed successfully.
Apr 08 11:02:56 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c 1073741824" returned: 0 in 0.770s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:56 devstack sudo[83902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c
Apr 08 11:02:56 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Acquiring lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c2560-13e9-4308-9b8e-284334a50d0b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:56 devstack sudo[83905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587
Apr 08 11:02:56 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:56 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c" returned: 0 in 0.536s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a609224-1e46-4e1f-8a78-44d2ebf7f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1156e5ab-1a1f-469b-891b-3b23e987236c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b13d367-1715-47f1-ae40-df8d6f60ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:02:56 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Volume volume-1156e5ab-1a1f-469b-891b-3b23e987236c (1156e5ab-1a1f-469b-891b-3b23e987236c): created successfully
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b13d367-1715-47f1-ae40-df8d6f60ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Flow 'volume_create_manager' (6bcf0627-b005-4175-b317-ccf5f203a179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:02:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-874fa841-8c1d-47f2-9353-c645f272305f req-1e5a8ac5-7b06-4190-8a3b-65adab4542e8 tempest-VolumesGetTestJSON-498432293 None] Created volume successfully.
Apr 08 11:02:56 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587" returned: 0 in 0.658s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:56 devstack sudo[84227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587
Apr 08 11:02:56 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Acquiring lock "cinder-1156e5ab-1a1f-469b-891b-3b23e987236c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "cinder-1156e5ab-1a1f-469b-891b-3b23e987236c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Acquiring lock "cinder-quobyte-1156e5ab-1a1f-469b-891b-3b23e987236c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "cinder-quobyte-1156e5ab-1a1f-469b-891b-3b23e987236c" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c1bf72-e18a-4f9f-86a6-df81bb77d1a3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:57 devstack sudo[84229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c
Apr 08 11:02:57 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:57 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc4f24df-b373-4c39-95a1-1e4738d11587" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-dc4f24df-b373-4c39-95a1-1e4738d11587" released by "delete_volume" :: held 1.174s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Created reservations ['8d8385ea-bdc3-48e8-a9ea-7c95b9478756'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:57 devstack cinder-volume[82670]: WARNING cinder.quota [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1899373682 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1899373682, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:02:57 devstack cinder-volume[82670]: WARNING cinder.quota [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1899373682 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1899373682, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Created reservations ['b19a1e2b-aa40-46c4-9b3b-92ba3e2fcc18', '54eccc0d-ffde-4220-a56b-79a3799161d5', 'dcc89761-234c-464d-af7e-27a4508e2361', 'ab57121b-c159-444e-b5ea-3c7842cf51bc'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:57 devstack sudo[84233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:02:57 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:57 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c" returned: 0 in 0.625s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:57 devstack sudo[84238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c
Apr 08 11:02:57 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:58 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.440s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:02:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-082f6e55-1a64-49ed-86c4-b56c501f16b1 tempest-GroupsV314Test-833046745 None] Delete group completed successfully.
Apr 08 11:02:58 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1156e5ab-1a1f-469b-891b-3b23e987236c" returned: 0 in 0.515s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "cinder-quobyte-1156e5ab-1a1f-469b-891b-3b23e987236c" released by "delete_volume" :: held 1.159s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.quota [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Created reservations ['e0259281-7fd1-487b-addc-0997a3835f5e', '2fea0b2b-2c94-482f-8d54-af7284da8f8e', '495b6b9b-59f7-4b75-9017-4a3242eea961', 'e7d97fbd-efa5-47fb-aa2e-9750d3d89686'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:58 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:02:58 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Acquiring lock "cinder-quobyte-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2733b-fd34-42cc-a487-49dc7ef99b13]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:58 devstack sudo[84245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:58 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:58 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.524s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.manager [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:02:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Deleted volume successfully.
Apr 08 11:02:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-ce902a6b-1082-437f-94e9-1494bad6b26f req-40cdbd0d-9b57-4b59-8b17-01f97d3e6e35 tempest-VolumesGetTestJSON-498432293 None] Lock "cinder-1156e5ab-1a1f-469b-891b-3b23e987236c-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:02:59 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.570s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:02:59 devstack sudo[84252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4
Apr 08 11:02:59 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:02:59 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root
Apr 08 11:02:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" returned: 0 in 0.640s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:02:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Lock "cinder-quobyte-6d5a9019-d776-4127-a6bb-e0b6b66d7ad4" released by "delete_volume" :: held 1.255s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Created reservations ['15cb9301-6087-4a0b-9aac-5f4217182453'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Created reservations ['60a838d8-7647-4880-b469-d284eb0a51d8', 'c9f0ef76-696d-4f40-a871-343e4717824b', '094275bf-231d-46dc-98c5-9d533fb25ff3', 'ff088e0a-9478-447d-a321-333072f65c71'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:00 devstack sudo[84255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:00 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:00 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.747s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:00 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:00 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-563c720c-cb30-46bd-a150-bf5ded7564e2 tempest-GroupsV314Test-833046745 None] Delete group completed successfully.
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:02 devstack sudo[84310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:02 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:03 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.520s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-fe934fab-b9a9-4b0f-adbd-15f0734b46ce tempest-BackendsCapabilitiesAdminTestsJSON-339057129 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82670) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 08 11:03:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4c08842f-d6a6-473e-86cc-c770ce1f124f tempest-BackendsCapabilitiesAdminTestsJSON-339057129 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82670) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 08 11:03:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-c53ab3b5-c389-4dc8-b3c8-0e583eedd6f6 req-4e1ccb3c-777c-467a-98df-5cf3b09e9cac tempest-DeleteServersTestJSON-846669951 None] Terminate volume connection completed successfully.
Apr 08 11:03:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c53ab3b5-c389-4dc8-b3c8-0e583eedd6f6 req-4e1ccb3c-777c-467a-98df-5cf3b09e9cac tempest-DeleteServersTestJSON-846669951 None] Deleting attachment 22b80781-d0f9-4719-a219-0354ff20c706. {{(pid=82670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 08 11:03:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-64a0d109-14d6-4446-b407-c444bb812c9a tempest-GroupSnapshotsV319Test-1871039352 None] Group tempest-GroupSnapshotsV319Test-Group-1899501544: creating
Apr 08 11:03:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-64a0d109-14d6-4446-b407-c444bb812c9a tempest-GroupSnapshotsV319Test-1871039352 None] Group tempest-GroupSnapshotsV319Test-Group-1899501544: created successfully
Apr 08 11:03:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-64a0d109-14d6-4446-b407-c444bb812c9a tempest-GroupSnapshotsV319Test-1871039352 None] Create group completed successfully.
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Flow 'volume_create_manager' (27ff4594-80ef-4bac-b023-22584e513d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894d08e8-9dbb-4e32-a1be-f0249782b18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (894d08e8-9dbb-4e32-a1be-f0249782b18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955434012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d9f60024-a0db-48db-b6f0-a2e80c8b9c85,host='devstack@QuobyteHD#QuobyteHD',id=6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6b5bc5f23b4ac48189176942d50988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:08Z,use_quota=True,user_id='a361f458f87b41ea99d4ecf1f01bb4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94cf1b45-b48c-415b-883d-0bf1019b7543),volume_type_id=94cf1b45-b48c-415b-883d-0bf1019b7543)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d7fb1-2139-4f66-a164-951e28736af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4d7fb1-2139-4f66-a164-951e28736af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81537b0-4b7b-4d26-affa-a0654a090d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81537b0-4b7b-4d26-affa-a0654a090d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1', 'volume_name': 'volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2087e30-f10c-4ff3-961e-724ea66c9177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2087e30-f10c-4ff3-961e-724ea66c9177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4548ea23-522d-4844-a4a8-4f2941031a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:07 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Volume 6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1', 'volume_size': 1}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d9f60024-a0db-48db-b6f0-a2e80c8b9c85,created_at=2026-04-08T09:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-955434012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d9f60024-a0db-48db-b6f0-a2e80c8b9c85,host='devstack@QuobyteHD#QuobyteHD',id=6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6b5bc5f23b4ac48189176942d50988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:08Z,use_quota=True,user_id='a361f458f87b41ea99d4ecf1f01bb4c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94cf1b45-b48c-415b-883d-0bf1019b7543),volume_type_id=94cf1b45-b48c-415b-883d-0bf1019b7543)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Creating volume 6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:07 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:07 devstack sudo[84322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 1073741824
Apr 08 11:03:07 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "cinder-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "cinder-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "cinder-quobyte-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "cinder-quobyte-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fd9685-3712-415b-8721-26f0c37288d0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:08 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 1073741824" returned: 0 in 0.737s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:08 devstack sudo[84327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786
Apr 08 11:03:08 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:08 devstack sudo[84329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1
Apr 08 11:03:08 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7e5b9fa1-4a71-4b69-8d7f-b7cbac26934a tempest-GroupsV320Test-162269984 None] Group tempest-GroupsV320Test-Group-1821463922: creating
Apr 08 11:03:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7e5b9fa1-4a71-4b69-8d7f-b7cbac26934a tempest-GroupsV320Test-162269984 None] Group tempest-GroupsV320Test-Group-1821463922: created successfully
Apr 08 11:03:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7e5b9fa1-4a71-4b69-8d7f-b7cbac26934a tempest-GroupsV320Test-162269984 None] Create group completed successfully.
Apr 08 11:03:08 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" returned: 0 in 0.568s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:08 devstack sudo[84335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786
Apr 08 11:03:08 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:08 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" returned: 0 in 0.501s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4548ea23-522d-4844-a4a8-4f2941031a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7223409-2135-4925-a353-642f2bdd6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:09 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Volume volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 (6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1): created successfully
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7223409-2135-4925-a353-642f2bdd6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Flow 'volume_create_manager' (27ff4594-80ef-4bac-b023-22584e513d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-cb6f1ef6-9252-4be9-97ca-28d86cd3d0eb tempest-GroupSnapshotsV319Test-1871039352 None] Created volume successfully.
Apr 08 11:03:09 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" returned: 0 in 0.504s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "cinder-quobyte-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786" released by "delete_volume" :: held 1.095s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Created reservations ['70072dcb-6513-455f-a684-83549a364d40', '4963ffdf-40bb-43ed-9976-152341ff7d08', '72aba4a3-8d7e-4867-8d6c-7bc026bbb72e', 'a67471e5-1502-4d12-9c8c-18b532824539'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:09 devstack sudo[84338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:09 devstack sudo[84338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] GroupSnapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: creating.
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Group snapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: creating. {{(pid=82670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Creating offline snapshot 2feca3d9-24a6-43f9-b26a-04a5c59a2926 of volume 6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f22148-a614-4d7a-95da-7645197cd37b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:09 devstack sudo[84338]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Deleted volume successfully.
Apr 08 11:03:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-18970f65-a8c7-419e-bfae-d2e2bac18e1b tempest-DeleteServersTestJSON-846669951 None] Lock "cinder-bb2caf7c-d9f9-4bbb-a45f-dcd7182fa786-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:10 devstack sudo[84341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1
Apr 08 11:03:10 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Created reservations ['368d6ada-fccc-4a59-93f4-9a41b685c509'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:10 devstack sudo[84343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:10 devstack sudo[84343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:10 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" returned: 0 in 0.644s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:10 devstack sudo[84349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 1G
Apr 08 11:03:10 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:10 devstack sudo[84343]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:10 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-59888f95-4d66-4539-b50d-15d4bcdacb75 tempest-GroupsV320Test-162269984 None] Delete group completed successfully.
Apr 08 11:03:11 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 1G" returned: 0 in 0.556s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:11 devstack sudo[84354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926
Apr 08 11:03:11 devstack sudo[84354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:11 devstack sudo[84354]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:11 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:03:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:11 devstack sudo[84360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926
Apr 08 11:03:11 devstack sudo[84360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:12 devstack sudo[84360]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:12 devstack sudo[84364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info
Apr 08 11:03:12 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:12 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info" returned: 0 in 0.463s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:12 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:03:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:12 devstack sudo[84368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info
Apr 08 11:03:12 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:13 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.info" returned: 0 in 0.633s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.328s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:13 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c2515de8-4245-40c3-ab98-e6cba97e7fa3 tempest-GroupSnapshotsV319Test-1871039352 None] group_snapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: created successfully
Apr 08 11:03:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] group_snapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: deleting
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] group_snapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: deleting {{(pid=82670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "cinder-quobyte-2feca3d9-24a6-43f9-b26a-04a5c59a2926" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-2feca3d9-24a6-43f9-b26a-04a5c59a2926" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Deleting offline snapshot 2feca3d9-24a6-43f9-b26a-04a5c59a2926 of volume 6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] snapshot_file for this snap is: volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd190cf5-c573-4d1f-9ed8-65601af00453]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:14 devstack sudo[84373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926
Apr 08 11:03:14 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:15 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926" returned: 0 in 0.503s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1fff5-4104-4747-98f8-f0551953c24c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:15 devstack sudo[84378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1
Apr 08 11:03:15 devstack sudo[84378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Flow 'volume_create_manager' (427d0148-9e96-4fac-88eb-05413f9cfb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61a4b4-c3a2-4ba5-8ceb-04b6c706a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e61a4b4-c3a2-4ba5-8ceb-04b6c706a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1713533054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972af941-4295-47c2-8ffa-0a9e6c6db7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f72ee1b6d4a47658d257ccd23880d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:16Z,use_quota=True,user_id='86c0501f728e43ce8a0b297515b76a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d78722-e4db-49e6-9c1a-7fb9b9942e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d78722-e4db-49e6-9c1a-7fb9b9942e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502bb48d-1539-45db-a637-5736dd00c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502bb48d-1539-45db-a637-5736dd00c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972af941-4295-47c2-8ffa-0a9e6c6db7f9', 'volume_name': 'volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4788f768-e562-4c29-8205-17a464a7f14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4788f768-e562-4c29-8205-17a464a7f14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d8ce3b-15a9-47e1-8f4a-9f27b2f32c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9', 'volume_size': 1}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1713533054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972af941-4295-47c2-8ffa-0a9e6c6db7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f72ee1b6d4a47658d257ccd23880d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:16Z,use_quota=True,user_id='86c0501f728e43ce8a0b297515b76a42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Creating volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:15 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:15 devstack sudo[84383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 1073741824
Apr 08 11:03:15 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:15 devstack sudo[84378]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" returned: 0 in 0.839s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:15 devstack sudo[84385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926
Apr 08 11:03:15 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Flow 'volume_create_manager' (e5bacdca-55ac-463e-add7-4bdfa84dbf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f877af94-4cbc-4667-880d-b2c397297138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f877af94-4cbc-4667-880d-b2c397297138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1552854926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6244d897-81cf-40d6-961c-c3df5a4691fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8f3a6a937649c38951f3c82e55c2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:16Z,use_quota=True,user_id='3243034dfb8c4d68a4dc3c29845ae298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2aee1a7-a754-4fe1-a9ee-d6a61a40d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2aee1a7-a754-4fe1-a9ee-d6a61a40d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65dc278-9dc6-491e-b492-605193c7795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65dc278-9dc6-491e-b492-605193c7795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6244d897-81cf-40d6-961c-c3df5a4691fe', 'volume_name': 'volume-6244d897-81cf-40d6-961c-c3df5a4691fe', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce5a02-526e-4fe4-b9b5-a6253c3a6ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ce5a02-526e-4fe4-b9b5-a6253c3a6ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9636ccd5-726e-44be-add8-ef47d996ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume 6244d897-81cf-40d6-961c-c3df5a4691fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6244d897-81cf-40d6-961c-c3df5a4691fe', 'volume_size': 1}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:16 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 1073741824" returned: 0 in 0.658s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:16 devstack sudo[84393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9
Apr 08 11:03:16 devstack sudo[84393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:16 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926" returned: 0 in 0.594s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:16 devstack sudo[84395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926
Apr 08 11:03:16 devstack sudo[84395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:16 devstack sudo[84393]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9" returned: 0 in 0.415s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.582s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1552854926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6244d897-81cf-40d6-961c-c3df5a4691fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8f3a6a937649c38951f3c82e55c2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:16Z,use_quota=True,user_id='3243034dfb8c4d68a4dc3c29845ae298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Creating volume 6244d897-81cf-40d6-961c-c3df5a4691fe {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:16 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d8ce3b-15a9-47e1-8f4a-9f27b2f32c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a234bb-73f3-4fb0-b4c5-88fcce16fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:16 devstack sudo[84400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe 1073741824
Apr 08 11:03:16 devstack sudo[84400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:16 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Volume volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 (972af941-4295-47c2-8ffa-0a9e6c6db7f9): created successfully
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a234bb-73f3-4fb0-b4c5-88fcce16fadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Flow 'volume_create_manager' (427d0148-9e96-4fac-88eb-05413f9cfb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0e2717c0-78dd-43e1-8fc9-22af4681991d tempest-SnapshotsActionsTest-844207604 None] Created volume successfully.
Apr 08 11:03:16 devstack sudo[84395]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1.2feca3d9-24a6-43f9-b26a-04a5c59a2926" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-2feca3d9-24a6-43f9-b26a-04a5c59a2926" released by "_delete_snapshot" :: held 2.496s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" released by "delete_snapshot" :: held 2.511s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:17 devstack cinder-volume[82670]: WARNING cinder.quota [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-664698549 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-664698549, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:17 devstack cinder-volume[82670]: WARNING cinder.quota [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-664698549 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-664698549, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] Created reservations ['99735515-f364-4db5-94df-66d3423b776e', '6be8041a-1fa2-4f4b-bcec-683e64fdb208', '27416647-5c6c-44ec-9088-13c4a1c016c6', '40758d0e-5100-489f-a3bf-e876de65ba36'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b1c313f3-3d35-4f68-9638-c5bf82dd079d tempest-GroupSnapshotsV319Test-1871039352 None] group_snapshot 21aa0ad5-bd8e-4f42-bba4-d99382ef84e7: deleted successfully
Apr 08 11:03:17 devstack sudo[84400]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe 1073741824" returned: 0 in 0.553s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:17 devstack sudo[84405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe
Apr 08 11:03:17 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:17 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe" returned: 0 in 0.456s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9636ccd5-726e-44be-add8-ef47d996ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6244d897-81cf-40d6-961c-c3df5a4691fe', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7213ca3e-7b81-4fb8-8644-fbcd41ff4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" acquired by "delete_volume" :: waited 0.030s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:17 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume volume-6244d897-81cf-40d6-961c-c3df5a4691fe (6244d897-81cf-40d6-961c-c3df5a4691fe): created successfully
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7213ca3e-7b81-4fb8-8644-fbcd41ff4880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Flow 'volume_create_manager' (e5bacdca-55ac-463e-add7-4bdfa84dbf12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df6ae4d-3547-48b8-b92b-8d91e087bf33]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8f0afeb3-a38f-4e52-84fd-1a4a6f1c1649 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Created volume successfully.
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Creating offline snapshot 45337616-2954-4a96-8c6b-ff71a8c5ee44 of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d673b-b51a-4b1c-b5f6-68e0efd0a2f5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:18 devstack sudo[84408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1
Apr 08 11:03:18 devstack sudo[84408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:18 devstack sudo[84409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9
Apr 08 11:03:18 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "cinder-6244d897-81cf-40d6-961c-c3df5a4691fe-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "cinder-6244d897-81cf-40d6-961c-c3df5a4691fe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "cinder-quobyte-6244d897-81cf-40d6-961c-c3df5a4691fe" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "cinder-quobyte-6244d897-81cf-40d6-961c-c3df5a4691fe" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb917cc-d263-4d0d-ac83-b0e27e2bfe13]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:18 devstack sudo[84418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe
Apr 08 11:03:18 devstack sudo[84418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:18 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9" returned: 0 in 0.489s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:18 devstack sudo[84408]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" returned: 0 in 0.572s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:18 devstack sudo[84420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 1G
Apr 08 11:03:18 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:18 devstack sudo[84421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1
Apr 08 11:03:18 devstack sudo[84421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack sudo[84421]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" returned: 0 in 0.498s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "cinder-quobyte-6a2d8b1c-6b77-4c73-b52e-edf7934f1ca1" released by "delete_volume" :: held 1.113s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Created reservations ['ef6e6d10-d066-464d-8e99-bbfe54961726'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:19 devstack sudo[84418]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe" returned: 0 in 0.654s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:19 devstack cinder-volume[82670]: WARNING cinder.quota [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-664698549 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-664698549, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:19 devstack sudo[84431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe
Apr 08 11:03:19 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 1G" returned: 0 in 0.606s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Created reservations ['36db25f0-4ce1-4a40-aa06-efced69013a6', 'f66ceb53-fa0c-4316-8646-317118474622', '867775c7-9a9d-42c4-a8d0-5f04a8fb2239', '5932ce0f-840c-44a1-9009-6bb163d9459b'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:19 devstack sudo[84433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:19 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:19 devstack sudo[84435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:19 devstack sudo[84435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6244d897-81cf-40d6-961c-c3df5a4691fe" returned: 0 in 0.459s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "cinder-quobyte-6244d897-81cf-40d6-961c-c3df5a4691fe" released by "delete_volume" :: held 1.144s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Created reservations ['83f51342-94da-4641-9844-b2ac667452e3', '159409f8-fba2-43f8-8043-476485d29672', '3269beab-efd4-4d9b-a284-ded494fa8f42', '59e3fa8a-56aa-4cf9-9d36-e5f7771d170b'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:19 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 is being set with open permissions: ugo+rw
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:19 devstack sudo[84442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:19 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack sudo[84443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:19 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:19 devstack sudo[84435]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.567s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:19 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:19 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3a0f617c-668a-4892-97d5-23aeac616fe2 tempest-GroupSnapshotsV319Test-1871039352 None] Delete group completed successfully.
Apr 08 11:03:20 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:20 devstack sudo[84448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info
Apr 08 11:03:20 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:20 devstack sudo[84448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Deleted volume successfully.
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3ede7692-c303-4658-a888-b75e4db4a1ca tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "cinder-6244d897-81cf-40d6-961c-c3df5a4691fe-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:20 devstack sudo[84448]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info" returned: 0 in 0.513s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:20 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info is being set with open permissions: ugo+rw
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:20 devstack sudo[84451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info
Apr 08 11:03:20 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:20 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Flow 'volume_create_manager' (c5243292-4319-4e5c-94de-88f8ccfd5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1277aee-4b45-4db3-bcbd-28bb2f265295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1277aee-4b45-4db3-bcbd-28bb2f265295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1118292502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a26b0da-a378-4ef0-831f-1ab153c003f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8f3a6a937649c38951f3c82e55c2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:21Z,use_quota=True,user_id='3243034dfb8c4d68a4dc3c29845ae298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbef1f1d-5bf3-4a55-a531-e2267b57aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbef1f1d-5bf3-4a55-a531-e2267b57aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20723b4c-c39a-4215-a2fb-edef48b9382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20723b4c-c39a-4215-a2fb-edef48b9382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a26b0da-a378-4ef0-831f-1ab153c003f6', 'volume_name': 'volume-4a26b0da-a378-4ef0-831f-1ab153c003f6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97b639f-f745-4f98-bf4a-ffa0d62c92aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97b639f-f745-4f98-bf4a-ffa0d62c92aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98434433-b1ab-4302-8c7f-6f1a202db34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume 4a26b0da-a378-4ef0-831f-1ab153c003f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a26b0da-a378-4ef0-831f-1ab153c003f6', 'volume_size': 1}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:21 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.info" returned: 0 in 0.552s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1118292502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a26b0da-a378-4ef0-831f-1ab153c003f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8f3a6a937649c38951f3c82e55c2fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:21Z,use_quota=True,user_id='3243034dfb8c4d68a4dc3c29845ae298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Creating volume 4a26b0da-a378-4ef0-831f-1ab153c003f6 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:21 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:21 devstack sudo[84454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 1073741824
Apr 08 11:03:21 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-397c5e1c-7e59-4dfd-896d-754e54de2605 tempest-SnapshotsActionsTest-844207604 None] Create snapshot completed successfully
Apr 08 11:03:21 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 1073741824" returned: 0 in 0.566s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:21 devstack sudo[84460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6
Apr 08 11:03:21 devstack sudo[84460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:22 devstack sudo[84460]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98434433-b1ab-4302-8c7f-6f1a202db34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a26b0da-a378-4ef0-831f-1ab153c003f6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d76c1f-b831-4303-b26e-5d3a8becbf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:22 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Volume volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 (4a26b0da-a378-4ef0-831f-1ab153c003f6): created successfully
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d76c1f-b831-4303-b26e-5d3a8becbf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Flow 'volume_create_manager' (c5243292-4319-4e5c-94de-88f8ccfd5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:22 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6cb60780-b9a6-4764-b687-a14a05ca59d0 tempest-VolumeQuotasAdminTestJSON-1947391531 None] Created volume successfully.
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Creating offline snapshot 24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7f3f87-78f5-496b-88d4-7b6f2b798216]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:22 devstack sudo[84463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:22 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:23 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.564s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:23 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be 1G
Apr 08 11:03:23 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e233fa01-32db-4d5b-88de-4c566cc77443 tempest-GroupsTest-1138849262 None] Group tempest-Group1-719403621: creating
Apr 08 11:03:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e233fa01-32db-4d5b-88de-4c566cc77443 tempest-GroupsTest-1138849262 None] Group tempest-Group1-719403621: created successfully
Apr 08 11:03:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e233fa01-32db-4d5b-88de-4c566cc77443 tempest-GroupsTest-1138849262 None] Create group completed successfully.
Apr 08 11:03:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-28a7323d-af58-4d42-807f-5e0de458131c tempest-VolumeQuotasAdminTestJSON-1061152212 None] Transfer volume completed successfully.
Apr 08 11:03:23 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be 1G" returned: 0 in 0.606s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:23 devstack sudo[84480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be
Apr 08 11:03:23 devstack sudo[84480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:24 devstack sudo[84480]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:24 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be is being set with open permissions: ugo+rw
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:24 devstack sudo[84485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be
Apr 08 11:03:24 devstack sudo[84485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Acquiring lock "cinder-4a26b0da-a378-4ef0-831f-1ab153c003f6-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "cinder-4a26b0da-a378-4ef0-831f-1ab153c003f6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Acquiring lock "cinder-quobyte-4a26b0da-a378-4ef0-831f-1ab153c003f6" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "cinder-quobyte-4a26b0da-a378-4ef0-831f-1ab153c003f6" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b5de8-c3a3-43c5-8a07-6150c3ddea48]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:24 devstack sudo[84487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6
Apr 08 11:03:24 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f9b8729a-d6d6-41bc-b1ee-757db0479ec2 tempest-GroupsTest-1138849262 None] Group tempest-Group2-1660199716: creating
Apr 08 11:03:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f9b8729a-d6d6-41bc-b1ee-757db0479ec2 tempest-GroupsTest-1138849262 None] Group tempest-Group2-1660199716: created successfully
Apr 08 11:03:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f9b8729a-d6d6-41bc-b1ee-757db0479ec2 tempest-GroupsTest-1138849262 None] Create group completed successfully.
Apr 08 11:03:24 devstack sudo[84485]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" returned: 0 in 0.467s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b2117907-a4ee-4835-ba0b-e015b227d6eb tempest-SnapshotsActionsTest-844207604 None] Create snapshot completed successfully
Apr 08 11:03:25 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:25 devstack sudo[84493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6
Apr 08 11:03:25 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:25 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a26b0da-a378-4ef0-831f-1ab153c003f6" returned: 0 in 0.425s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "cinder-quobyte-4a26b0da-a378-4ef0-831f-1ab153c003f6" released by "delete_volume" :: held 0.992s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Created reservations ['c4a107e8-646c-415f-ae7d-bbf91e435b58', 'd7a94801-ca68-4aa3-be11-16b7574bb489', '11bed7ac-43c4-4026-8fd2-301425d12280', 'd8421bb4-c851-4a2c-ad07-5d496331cd21'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:25 devstack sudo[84496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:25 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:26 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (4663ad37-162a-4cdb-b491-082340b3038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179f211c-4cfb-43a9-9395-9942f6f6bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:26 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Deleted volume successfully.
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (179f211c-4cfb-43a9-9395-9942f6f6bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578085817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2a162dda-66ca-4da5-9985-56c01af6f793,host='devstack@QuobyteHD#QuobyteHD',id=d16fe998-5043-4169-861c-ca4b22fa16da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:26Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc879d5b-e64e-41b8-bf5f-3173ba848e6e),volume_type_id=fc879d5b-e64e-41b8-bf5f-3173ba848e6e)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a39250-5625-409a-83b0-f9e6b9eb0168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a39250-5625-409a-83b0-f9e6b9eb0168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0aa5e27-e193-40ed-bfae-358f42d4bcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0aa5e27-e193-40ed-bfae-358f42d4bcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16fe998-5043-4169-861c-ca4b22fa16da', 'volume_name': 'volume-d16fe998-5043-4169-861c-ca4b22fa16da', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bbc5b2-28ec-4d35-8864-8109851530d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bbc5b2-28ec-4d35-8864-8109851530d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdcdea7-eeb7-4c8d-9e91-1ffb48a48261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:26 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Volume d16fe998-5043-4169-861c-ca4b22fa16da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16fe998-5043-4169-861c-ca4b22fa16da', 'volume_size': 1}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2a162dda-66ca-4da5-9985-56c01af6f793,created_at=2026-04-08T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578085817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2a162dda-66ca-4da5-9985-56c01af6f793,host='devstack@QuobyteHD#QuobyteHD',id=d16fe998-5043-4169-861c-ca4b22fa16da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:26Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc879d5b-e64e-41b8-bf5f-3173ba848e6e),volume_type_id=fc879d5b-e64e-41b8-bf5f-3173ba848e6e)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Creating volume d16fe998-5043-4169-861c-ca4b22fa16da {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:26 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:26 devstack sudo[84499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da 1073741824
Apr 08 11:03:26 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f27019c2-6726-4c20-a6f1-d31612efec09 tempest-VolumeQuotasAdminTestJSON-324058867 None] Lock "cinder-4a26b0da-a378-4ef0-831f-1ab153c003f6-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Deleting offline snapshot 24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] snapshot_file for this snap is: volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[92828f30-de2a-45d1-b89c-0b6aed07f79a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:26 devstack sudo[84501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be
Apr 08 11:03:26 devstack sudo[84501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:26 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da 1073741824" returned: 0 in 0.615s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:26 devstack sudo[84509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da
Apr 08 11:03:26 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:26 devstack sudo[84501]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" returned: 0 in 0.603s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ae4d0-5300-44e3-80be-863927cd0e39]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:26 devstack sudo[84511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:26 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:27 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acdcdea7-eeb7-4c8d-9e91-1ffb48a48261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16fe998-5043-4169-861c-ca4b22fa16da', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a814bf2-5149-4166-b8c5-38804310b11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:27 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Volume volume-d16fe998-5043-4169-861c-ca4b22fa16da (d16fe998-5043-4169-861c-ca4b22fa16da): created successfully
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a814bf2-5149-4166-b8c5-38804310b11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (4663ad37-162a-4cdb-b491-082340b3038e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d20a3197-e070-44ea-8463-bba92082bc5e tempest-GroupsTest-1138849262 None] Created volume successfully.
Apr 08 11:03:27 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:27 devstack sudo[84518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be
Apr 08 11:03:27 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:28 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" returned: 0 in 0.574s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:28 devstack sudo[84523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be
Apr 08 11:03:28 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Acquiring lock "cinder-quobyte-d16fe998-5043-4169-861c-ca4b22fa16da" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-d16fe998-5043-4169-861c-ca4b22fa16da" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace39bce-fab1-4176-a021-e721aa47d7ff]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:28 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" returned: 0 in 0.570s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be" released by "_delete_snapshot" :: held 2.390s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_snapshot" :: held 2.412s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:28 devstack sudo[84526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da
Apr 08 11:03:28 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Created reservations ['7a9078ad-5605-4911-bd43-87219d37d150', 'c2725505-07ef-4fd4-b680-de6cc2bfd9c2', '0ac3d0b1-7203-4074-ae06-48996395da14', 'b65e1a1a-5e5c-45bd-a4dd-a769ce96beeb'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Delete snapshot completed successfully.
Apr 08 11:03:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5c0c7b33-6f08-408e-8a80-7dfb9e9d4e92 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-24ce3f7b-d1c5-40ec-8bd0-fd33dd32f7be-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:29 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da" returned: 0 in 0.690s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:29 devstack sudo[84531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da
Apr 08 11:03:29 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Creating offline snapshot d8c919b6-e618-44aa-ba94-b78258ec729c of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3d3248-6da3-4f70-9eba-4de02a324b65]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:29 devstack sudo[84551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:29 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:29 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d16fe998-5043-4169-861c-ca4b22fa16da" returned: 0 in 0.617s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-d16fe998-5043-4169-861c-ca4b22fa16da" released by "delete_volume" :: held 1.343s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Created reservations ['164b9044-184d-48ed-be6f-1794ee32c4a0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:29 devstack cinder-volume[82670]: WARNING cinder.quota [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1857077423 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1857077423, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:29 devstack cinder-volume[82670]: WARNING cinder.quota [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1857077423 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1857077423, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:29 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Created reservations ['17951ad6-9ae7-4f26-adc7-cf06c8d89d90', 'a2f6dd0a-9239-442f-a642-5d281f7c3f95', '3fbad9f7-291b-4d81-80d4-1a9911fdf2b9', '5b658aea-9c0b-47d9-a637-f89935286cb0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:30 devstack sudo[84559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:30 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:30 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Flow 'volume_create_manager' (d9bb23fb-14c4-4c1a-9c58-2c4119aaeb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702b9346-5a06-485b-a636-9b4ca077e706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.675s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:30 devstack sudo[84564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c 1G
Apr 08 11:03:30 devstack sudo[84564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702b9346-5a06-485b-a636-9b4ca077e706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-477849984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f15674-3641-4d6e-8243-cb8d0d1266ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e968e9f042ae4a59a30409b814148aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:30Z,use_quota=True,user_id='cca42e2f72174ef5a6172c98e8399fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8c106b-7b5e-4230-baa4-b4b9c1b12e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8c106b-7b5e-4230-baa4-b4b9c1b12e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe163e-1f1d-48f7-aff4-9e91ed44c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe163e-1f1d-48f7-aff4-9e91ed44c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f15674-3641-4d6e-8243-cb8d0d1266ac', 'volume_name': 'volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145fa8a4-46e1-4afb-8e6f-9ba806d511d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145fa8a4-46e1-4afb-8e6f-9ba806d511d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa32e83-f1ba-4a80-8e59-e77ee20cecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:30 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Volume c6f15674-3641-4d6e-8243-cb8d0d1266ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac', 'volume_size': 1}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:30 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.468s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-77f6f44c-2e11-499d-a888-a635f37716dd tempest-GroupsTest-1138849262 None] Delete group completed successfully.
Apr 08 11:03:30 devstack sudo[84564]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Created reservations ['3e1cc14f-baf6-4982-a855-4aaa4a802543'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c 1G" returned: 0 in 0.515s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:30 devstack sudo[84570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c
Apr 08 11:03:30 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:30 devstack sudo[84572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:30 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:31 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:31 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c is being set with open permissions: ugo+rw
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:31 devstack sudo[84578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c
Apr 08 11:03:31 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:31 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.422s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-57b2a136-3358-4841-8e9d-b408ac536416 tempest-GroupsTest-1138849262 None] Delete group completed successfully.
Apr 08 11:03:31 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-477849984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f15674-3641-4d6e-8243-cb8d0d1266ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e968e9f042ae4a59a30409b814148aac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:30Z,use_quota=True,user_id='cca42e2f72174ef5a6172c98e8399fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Creating volume c6f15674-3641-4d6e-8243-cb8d0d1266ac {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:31 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:31 devstack sudo[84582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac 1073741824
Apr 08 11:03:31 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dc2a2bed-ae56-426d-9522-31813824ea23 tempest-SnapshotsActionsTest-844207604 None] Create snapshot completed successfully
Apr 08 11:03:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8b965ed2-3840-4e9c-9794-f56c18736e51 tempest-GroupsTest-1138849262 None] Group tempest-GroupsTest-Group-1689152630: creating
Apr 08 11:03:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8b965ed2-3840-4e9c-9794-f56c18736e51 tempest-GroupsTest-1138849262 None] Group tempest-GroupsTest-Group-1689152630: created successfully
Apr 08 11:03:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8b965ed2-3840-4e9c-9794-f56c18736e51 tempest-GroupsTest-1138849262 None] Create group completed successfully.
Apr 08 11:03:32 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac 1073741824" returned: 0 in 0.532s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:32 devstack sudo[84587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac
Apr 08 11:03:32 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:32 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac" returned: 0 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-d8c919b6-e618-44aa-ba94-b78258ec729c-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa32e83-f1ba-4a80-8e59-e77ee20cecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8180e28c-4dd7-439a-97e7-962594fdfaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=163,cinder:UPDATE=165,cinder:DELETE=14,cinder:INSERT=39 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-d8c919b6-e618-44aa-ba94-b78258ec729c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Volume volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac (c6f15674-3641-4d6e-8243-cb8d0d1266ac): created successfully
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8180e28c-4dd7-439a-97e7-962594fdfaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Flow 'volume_create_manager' (d9bb23fb-14c4-4c1a-9c58-2c4119aaeb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-d8c919b6-e618-44aa-ba94-b78258ec729c" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-bc01a736-7ddb-47b9-92c7-13aa9da91109 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Created volume successfully.
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-d8c919b6-e618-44aa-ba94-b78258ec729c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Deleting offline snapshot d8c919b6-e618-44aa-ba94-b78258ec729c of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] snapshot_file for this snap is: volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[994c4914-3ee4-4768-a578-3415c82523f1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:32 devstack sudo[84593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c
Apr 08 11:03:32 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:33 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ce58b3-15a3-46e2-8ee1-07cce9a72017]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:33 devstack sudo[84598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:33 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=152,cinder:UPDATE=163,cinder:INSERT=35,cinder:DELETE=7 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (2ceb5e3e-8e11-49f8-8f70-1076a04f2941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa0b99c-e15b-44d5-b625-572c5ea12a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa0b99c-e15b-44d5-b625-572c5ea12a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021207280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,host='devstack@QuobyteHD#QuobyteHD',id=cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:34Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7294903-ee4a-4078-ab6e-739868901dd9),volume_type_id=d7294903-ee4a-4078-ab6e-739868901dd9)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da29fe9a-b5b6-4620-bd5c-9491350eeceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da29fe9a-b5b6-4620-bd5c-9491350eeceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0a359e-2136-43c8-907f-1baa2f93c7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0a359e-2136-43c8-907f-1baa2f93c7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6', 'volume_name': 'volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212bc59b-020b-4812-ae75-1375ae3c9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212bc59b-020b-4812-ae75-1375ae3c9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1760e-aa70-4cbf-9e6a-186902821735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:33 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Volume cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6', 'volume_size': 1}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,created_at=2026-04-08T09:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021207280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,host='devstack@QuobyteHD#QuobyteHD',id=cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:34Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7294903-ee4a-4078-ab6e-739868901dd9),volume_type_id=d7294903-ee4a-4078-ab6e-739868901dd9)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Creating volume cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:33 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:33 devstack sudo[84600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 1073741824
Apr 08 11:03:33 devstack sudo[84600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:34 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.590s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:34 devstack sudo[84605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c
Apr 08 11:03:34 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Acquiring lock "cinder-c6f15674-3641-4d6e-8243-cb8d0d1266ac-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "cinder-c6f15674-3641-4d6e-8243-cb8d0d1266ac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Acquiring lock "cinder-quobyte-c6f15674-3641-4d6e-8243-cb8d0d1266ac" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "cinder-quobyte-c6f15674-3641-4d6e-8243-cb8d0d1266ac" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af90468-133a-4d9a-81ac-80e59b8a730b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:34 devstack sudo[84610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac
Apr 08 11:03:34 devstack sudo[84610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:34 devstack sudo[84600]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 1073741824" returned: 0 in 0.579s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:34 devstack sudo[84612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6
Apr 08 11:03:34 devstack sudo[84612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:34 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c" returned: 0 in 0.797s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:34 devstack sudo[84650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c
Apr 08 11:03:34 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:34 devstack sudo[84612]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" returned: 0 in 0.595s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f1760e-aa70-4cbf-9e6a-186902821735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac41f29-750c-420a-bb5c-5a9e46eb0e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:34 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Volume volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 (cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6): created successfully
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac41f29-750c-420a-bb5c-5a9e46eb0e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (2ceb5e3e-8e11-49f8-8f70-1076a04f2941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dc3c2f1d-adf2-41ce-87dd-9837ed552039 tempest-GroupsTest-1138849262 None] Created volume successfully.
Apr 08 11:03:35 devstack sudo[84610]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac" returned: 0 in 0.901s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:35 devstack sudo[84653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac
Apr 08 11:03:35 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:35 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.d8c919b6-e618-44aa-ba94-b78258ec729c" returned: 0 in 0.579s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-d8c919b6-e618-44aa-ba94-b78258ec729c" released by "_delete_snapshot" :: held 2.506s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_snapshot" :: held 2.525s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Created reservations ['86d718e4-58df-4ac0-84a3-2d02f33d04cc', '0dff404c-b6c5-4f73-8f23-70144f8fa809', 'c7795aa2-e4bd-46ee-ab3c-10e7ea172ce3', 'c9029a17-9ea2-43b5-8937-59800c34ea13'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Delete snapshot completed successfully.
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fc489b13-71d3-4ca1-9c17-7067954b191a tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-d8c919b6-e618-44aa-ba94-b78258ec729c-delete_snapshot" released by "delete_snapshot" :: held 2.641s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:35 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c6f15674-3641-4d6e-8243-cb8d0d1266ac" returned: 0 in 0.527s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "cinder-quobyte-c6f15674-3641-4d6e-8243-cb8d0d1266ac" released by "delete_volume" :: held 1.452s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Created reservations ['29afe636-d76a-41a8-a562-d4fd825aa1a6', '7d9d4d3d-eda3-423f-ae38-d790b0bf488a', '2ed73a71-501d-498a-85d8-25daae864f04', '2567e9ee-9824-44dc-92f0-32320607a73a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:35 devstack sudo[84665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:35 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (74b639fa-1929-4efc-a9ee-30f043b7517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ca4438-a888-4a9b-960e-5109efc15297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ca4438-a888-4a9b-960e-5109efc15297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519712008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,host='devstack@QuobyteHD#QuobyteHD',id=b215e179-a229-4aed-b454-d5e74fbb137b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:36Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7294903-ee4a-4078-ab6e-739868901dd9),volume_type_id=d7294903-ee4a-4078-ab6e-739868901dd9)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0b802e-6ab4-4551-aba3-96625f209141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0b802e-6ab4-4551-aba3-96625f209141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98763e94-2851-4c56-9caa-4d2ab48974e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98763e94-2851-4c56-9caa-4d2ab48974e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b215e179-a229-4aed-b454-d5e74fbb137b', 'volume_name': 'volume-b215e179-a229-4aed-b454-d5e74fbb137b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af831e4c-0061-4ac9-afc6-bbcd7d378dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af831e4c-0061-4ac9-afc6-bbcd7d378dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec01794-6235-4820-af15-9299c9f7055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:36 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Volume b215e179-a229-4aed-b454-d5e74fbb137b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b215e179-a229-4aed-b454-d5e74fbb137b', 'volume_size': 1}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,created_at=2026-04-08T09:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519712008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3249b6d0-b14e-4cab-abdc-3b5700cb24f0,host='devstack@QuobyteHD#QuobyteHD',id=b215e179-a229-4aed-b454-d5e74fbb137b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e09930fd24e2088b0d5ae930bbca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:36Z,use_quota=True,user_id='dcd74a93f3f842fe9768caa1a3de6d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7294903-ee4a-4078-ab6e-739868901dd9),volume_type_id=d7294903-ee4a-4078-ab6e-739868901dd9)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Creating volume b215e179-a229-4aed-b454-d5e74fbb137b {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:36 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:36 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b 1073741824
Apr 08 11:03:36 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:36 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.691s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Deleted volume successfully.
Apr 08 11:03:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2ba46cfb-8106-4916-ad3e-f171ba4dc958 tempest-VolumeQuotasNegativeTestJSON-39466906 None] Lock "cinder-c6f15674-3641-4d6e-8243-cb8d0d1266ac-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:37 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b 1073741824" returned: 0 in 0.829s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:37 devstack sudo[84708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b
Apr 08 11:03:37 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:37 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b" returned: 0 in 0.603s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.382s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Creating offline snapshot aa310274-1d22-4670-b2c9-bba9e753b73f of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec01794-6235-4820-af15-9299c9f7055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b215e179-a229-4aed-b454-d5e74fbb137b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11395d3d-57a4-4c5f-bedd-c436d956cd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d97c75-c90e-4450-b509-0628cd046a1b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:37 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Volume volume-b215e179-a229-4aed-b454-d5e74fbb137b (b215e179-a229-4aed-b454-d5e74fbb137b): created successfully
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11395d3d-57a4-4c5f-bedd-c436d956cd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Flow 'volume_create_manager' (74b639fa-1929-4efc-a9ee-30f043b7517c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8d8c95e1-3dca-4e92-aa96-d95d97a51731 tempest-GroupsTest-1138849262 None] Created volume successfully.
Apr 08 11:03:37 devstack sudo[84713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:37 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:38 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.559s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:38 devstack sudo[84718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f 1G
Apr 08 11:03:38 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6c766fbe-bc4f-4510-8ca9-269928ee34fb tempest-GroupsTest-1138849262 None] Update group completed successfully.
Apr 08 11:03:39 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f 1G" returned: 0 in 0.682s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:39 devstack sudo[84724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f
Apr 08 11:03:39 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:39 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f" returned: 0 in 0.612s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:39 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f is being set with open permissions: ugo+rw
Apr 08 11:03:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:39 devstack sudo[84729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f
Apr 08 11:03:39 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ac881b84-a5fd-40ed-aee4-a2eb1c479387 tempest-GroupsTest-1138849262 None] Update group completed successfully.
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Flow 'volume_create_manager' (b1f5aaba-957f-4ea8-be9d-a3770bd6149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf986e38-4c0a-4703-bfc6-729f37d2c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf986e38-4c0a-4703-bfc6-729f37d2c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2136264782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bee5ac-36b8-470f-9712-06c91ca02f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d296d24ae9d4950881c759d4244db76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:40Z,use_quota=True,user_id='583577408de4402d8b2f331cc19ed004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c632f7fc-7092-450e-9480-d2c93f4d832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c632f7fc-7092-450e-9480-d2c93f4d832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4ad5e8-b9c5-4903-8cc8-09c9056558ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4ad5e8-b9c5-4903-8cc8-09c9056558ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bee5ac-36b8-470f-9712-06c91ca02f90', 'volume_name': 'volume-00bee5ac-36b8-470f-9712-06c91ca02f90', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb02777-ca44-4ccd-917a-e539c87e96a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb02777-ca44-4ccd-917a-e539c87e96a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d1109c-6db4-41dd-b063-9daaa6ba5fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:40 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Volume 00bee5ac-36b8-470f-9712-06c91ca02f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bee5ac-36b8-470f-9712-06c91ca02f90', 'volume_size': 1}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:40 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f" returned: 0 in 0.521s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2136264782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bee5ac-36b8-470f-9712-06c91ca02f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d296d24ae9d4950881c759d4244db76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:40Z,use_quota=True,user_id='583577408de4402d8b2f331cc19ed004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Creating volume 00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:40 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:40 devstack sudo[84732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 1073741824
Apr 08 11:03:40 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:40 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-08ccf5c8-2c96-44d3-934b-7a1b475bacc5 tempest-SnapshotsActionsTest-844207604 None] Create snapshot completed successfully
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-aa310274-1d22-4670-b2c9-bba9e753b73f-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-aa310274-1d22-4670-b2c9-bba9e753b73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-aa310274-1d22-4670-b2c9-bba9e753b73f" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-aa310274-1d22-4670-b2c9-bba9e753b73f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Deleting offline snapshot aa310274-1d22-4670-b2c9-bba9e753b73f of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] snapshot_file for this snap is: volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a079882-2cf1-4950-916e-cbd2baec819b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:40 devstack sudo[84737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f
Apr 08 11:03:40 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:40 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 1073741824" returned: 0 in 0.552s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:40 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90
Apr 08 11:03:40 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Acquiring lock "cinder-quobyte-b215e179-a229-4aed-b454-d5e74fbb137b" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-b215e179-a229-4aed-b454-d5e74fbb137b" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a374f6d8-a37e-4b02-b20a-5edce7c28105]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:41 devstack sudo[84758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b
Apr 08 11:03:41 devstack sudo[84758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:41 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90" returned: 0 in 0.611s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d1109c-6db4-41dd-b063-9daaa6ba5fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bee5ac-36b8-470f-9712-06c91ca02f90', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:41 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d67ec2-3438-409e-ac7c-039be74a90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f" returned: 0 in 0.773s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Volume volume-00bee5ac-36b8-470f-9712-06c91ca02f90 (00bee5ac-36b8-470f-9712-06c91ca02f90): created successfully
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d67ec2-3438-409e-ac7c-039be74a90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Flow 'volume_create_manager' (b1f5aaba-957f-4ea8-be9d-a3770bd6149d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d7689-d1cf-4a89-86e4-041874141cab]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8bcce343-45b6-4955-ba62-72805f1f1e57 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Created volume successfully.
Apr 08 11:03:41 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:41 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:41 devstack sudo[84758]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b" returned: 0 in 0.532s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:41 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b
Apr 08 11:03:41 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:41 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:41 devstack sudo[84787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f
Apr 08 11:03:41 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:42 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b215e179-a229-4aed-b454-d5e74fbb137b" returned: 0 in 0.436s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-b215e179-a229-4aed-b454-d5e74fbb137b" released by "delete_volume" :: held 1.002s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Acquiring lock "cinder-quobyte-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22a3a1-d1ba-40c1-86a6-607f3c2dbfc4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:42 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6
Apr 08 11:03:42 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Creating offline snapshot 4e50ff02-11e4-455e-9951-04c4ad9eedc9 of volume 00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e6a2d-251c-4b22-b87a-d6ca32842809]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:42 devstack sudo[84795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90
Apr 08 11:03:42 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:42 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f" returned: 0 in 0.672s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:42 devstack sudo[84797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f
Apr 08 11:03:42 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:42 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" returned: 0 in 0.663s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:42 devstack sudo[84802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6
Apr 08 11:03:42 devstack sudo[84802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:43 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90" returned: 0 in 0.598s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:43 devstack sudo[84808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 1G
Apr 08 11:03:43 devstack sudo[84808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:43 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.aa310274-1d22-4670-b2c9-bba9e753b73f" returned: 0 in 0.643s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-aa310274-1d22-4670-b2c9-bba9e753b73f" released by "_delete_snapshot" :: held 2.632s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_snapshot" :: held 2.647s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Created reservations ['0e48f448-ed96-477c-a4d6-4aa96dea5472', '6e99e43f-89be-49ad-94f4-c29c877bc0b0', 'af7f913b-07a9-4b32-bb91-73a6d61c4571', 'b047ae34-795e-44f7-8e28-70400e958d12'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Delete snapshot completed successfully.
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1551cd62-93ca-4f79-a53d-6f3032d6944d tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-aa310274-1d22-4670-b2c9-bba9e753b73f-delete_snapshot" released by "delete_snapshot" :: held 2.762s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:43 devstack sudo[84802]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" returned: 0 in 0.674s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "cinder-quobyte-cc84b3fe-ae68-4096-bcb3-0e9a08aa61b6" released by "delete_volume" :: held 1.359s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Created reservations ['8f3cc761-d48c-4054-8973-e750a0160ac7'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:43 devstack cinder-volume[82670]: WARNING cinder.quota [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-598010974 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-598010974, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:43 devstack cinder-volume[82670]: WARNING cinder.quota [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-598010974 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-598010974, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Created reservations ['c2664e03-3abb-4e56-a647-4e82e61b3d94', 'c419d6fa-ae0d-4f3b-916c-8dd600f221f1', 'b3b49b83-9d36-4241-a06d-2dd0f6f6c912', 'b6490e23-bc24-4e48-ad48-00bedcdd77f5'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Created reservations ['7efcd4e3-fb51-4d40-8b42-55e1c455d84c', '80e6de31-84d9-4068-a51f-f85bf1e45383', 'f16632a8-e04b-45c9-897e-3a9d2c716d3b', '73d05d73-2e58-4d09-8d20-2c4750d2910e'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:43 devstack sudo[84814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:43 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:43 devstack sudo[84808]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 1G" returned: 0 in 0.730s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bee5ac-36b8-470f-9712-06c91ca02f90 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:43 devstack sudo[84816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bee5ac-36b8-470f-9712-06c91ca02f90 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9
Apr 08 11:03:43 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:44 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.541s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:44 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-de7bf437-c579-43ee-8d02-1b8949c6b3d5 tempest-GroupsTest-1138849262 None] Delete group completed successfully.
Apr 08 11:03:44 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00bee5ac-36b8-470f-9712-06c91ca02f90 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9" returned: 0 in 0.567s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:44 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 is being set with open permissions: ugo+rw
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:44 devstack sudo[84822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9
Apr 08 11:03:44 devstack sudo[84822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:44 devstack sudo[84822]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:44 devstack sudo[84825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info
Apr 08 11:03:44 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:45 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info" returned: 0 in 0.498s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:45 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info is being set with open permissions: ugo+rw
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:45 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info
Apr 08 11:03:45 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:45 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.info" returned: 0 in 0.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.389s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.803s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:45 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b8884589-7c5e-4d8a-8b40-252421ccc0e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Create snapshot completed successfully
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Creating offline snapshot 32928c9e-ab2b-4fbd-b1f9-b507d08b2823 of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62884120-abdc-4d5b-b6c5-5c7ad35ab753]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:45 devstack sudo[84832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:45 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:46 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.610s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:46 devstack sudo[84842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 1G
Apr 08 11:03:46 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "cinder-4e50ff02-11e4-455e-9951-04c4ad9eedc9-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-4e50ff02-11e4-455e-9951-04c4ad9eedc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "cinder-quobyte-4e50ff02-11e4-455e-9951-04c4ad9eedc9" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-4e50ff02-11e4-455e-9951-04c4ad9eedc9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Deleting offline snapshot 4e50ff02-11e4-455e-9951-04c4ad9eedc9 of volume 00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] snapshot_file for this snap is: volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c091c-73a2-4e56-9f40-1140ed5b399c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:47 devstack sudo[84847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9
Apr 08 11:03:47 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:47 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 1G" returned: 0 in 0.759s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:47 devstack sudo[84852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823
Apr 08 11:03:47 devstack sudo[84852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:47 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9" returned: 0 in 0.650s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00bee5ac-36b8-470f-9712-06c91ca02f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc0c09-4606-479e-9242-0939fd9a4fd7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:47 devstack sudo[84857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90
Apr 08 11:03:47 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:47 devstack sudo[84852]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:47 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 is being set with open permissions: ugo+rw
Apr 08 11:03:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:47 devstack sudo[84862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823
Apr 08 11:03:47 devstack sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:48 devstack sudo[84862]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823" returned: 0 in 0.482s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:48 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90" returned: 0 in 0.647s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:48 devstack sudo[84868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9
Apr 08 11:03:48 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:48 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e0a2b7af-4f5f-4fb0-bbda-db8e590cc6d0 tempest-SnapshotsActionsTest-844207604 None] Create snapshot completed successfully
Apr 08 11:03:48 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:48 devstack sudo[84873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9
Apr 08 11:03:48 devstack sudo[84873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:49 devstack sudo[84873]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90.4e50ff02-11e4-455e-9951-04c4ad9eedc9" returned: 0 in 0.467s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-32928c9e-ab2b-4fbd-b1f9-b507d08b2823-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-4e50ff02-11e4-455e-9951-04c4ad9eedc9" released by "_delete_snapshot" :: held 2.304s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" released by "delete_snapshot" :: held 2.324s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-32928c9e-ab2b-4fbd-b1f9-b507d08b2823-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Acquiring lock "cinder-quobyte-32928c9e-ab2b-4fbd-b1f9-b507d08b2823" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-32928c9e-ab2b-4fbd-b1f9-b507d08b2823" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Deleting offline snapshot 32928c9e-ab2b-4fbd-b1f9-b507d08b2823 of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] snapshot_file for this snap is: volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39478a6-3fc0-48b4-81cb-ed06b411ced4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Created reservations ['4ddc0d96-8231-49e2-9b5c-f50d730aac76', '301c27ec-d950-4a1f-ad5f-538f384bfa53', '45100ca9-9d69-4d44-aa72-a6f40defb468', 'a64c00a6-3d12-421b-85a2-21c5f6f58514'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:49 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Delete snapshot completed successfully.
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6483fa4b-560e-49bc-bf5f-555387703312 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-4e50ff02-11e4-455e-9951-04c4ad9eedc9-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:49 devstack sudo[84876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823
Apr 08 11:03:49 devstack sudo[84876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:49 devstack sudo[84876]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823" returned: 0 in 0.573s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2d27d-63e9-49be-9399-b54d670dc358]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:50 devstack sudo[84881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:50 devstack sudo[84881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "cinder-00bee5ac-36b8-470f-9712-06c91ca02f90-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-00bee5ac-36b8-470f-9712-06c91ca02f90-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5299a226-a671-4552-92fc-4667997bda7c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:50 devstack sudo[84883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90
Apr 08 11:03:50 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:50 devstack sudo[84881]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.527s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:50 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823
Apr 08 11:03:50 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:50 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90" returned: 0 in 0.553s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:50 devstack sudo[84895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90
Apr 08 11:03:50 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:51 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823" returned: 0 in 0.684s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:51 devstack sudo[84900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823
Apr 08 11:03:51 devstack sudo[84900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:51 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00bee5ac-36b8-470f-9712-06c91ca02f90" returned: 0 in 0.773s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-quobyte-00bee5ac-36b8-470f-9712-06c91ca02f90" released by "delete_volume" :: held 1.370s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Created reservations ['52d961c7-efc0-4d89-bde9-c604bf84d587', '8cdda051-480d-443f-b088-3491f95a5bdd', '810b2214-b08c-477e-8e84-a834d29d3549', '3b711db2-061f-4390-a74c-df348822f631'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:51 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:51 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:51 devstack sudo[84900]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.32928c9e-ab2b-4fbd-b1f9-b507d08b2823" returned: 0 in 0.657s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-32928c9e-ab2b-4fbd-b1f9-b507d08b2823" released by "_delete_snapshot" :: held 2.515s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_snapshot" :: held 2.539s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:51 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Created reservations ['edf0f3ad-d733-43cd-8cad-f54097b08071', 'e0157b94-33d7-447a-8d52-d4de2ffc7be0', 'dea989c9-10eb-4fad-a2c5-bfa1326c74a4', 'edbb477b-490c-4bcd-a8f9-71a934ba8a2d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Delete snapshot completed successfully.
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee2ad259-0726-45a3-9f34-6d04cd814868 tempest-SnapshotsActionsTest-2127138673 None] Lock "cinder-32928c9e-ab2b-4fbd-b1f9-b507d08b2823-delete_snapshot" released by "delete_snapshot" :: held 2.686s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:52 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.628s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Deleted volume successfully.
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-86ebfff2-83a1-4083-8be8-9d8a35433305 tempest-VolumeSnapshotQuotasNegativeTestJSON-695563793 None] Lock "cinder-00bee5ac-36b8-470f-9712-06c91ca02f90-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Flow 'volume_create_manager' (d95952eb-b8a7-4289-8fa0-4834e4267bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2658bbb-e20d-4458-82ee-9ae16a226372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2658bbb-e20d-4458-82ee-9ae16a226372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:52Z,deleted=False,deleted_at=None,display_description='',display_name='8c47140a-8b23-4671-a0b9-2356257bd284-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c46152-507c-400c-9c3a-daf3614913e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9f0253529845c685afa6cf02f849bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:53Z,use_quota=True,user_id='796f61acef604ddabf2f75d5a62d7867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204d159a-3e98-435e-997a-80db3c9fe2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204d159a-3e98-435e-997a-80db3c9fe2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aea92c-4bb8-44f9-af31-02692a5c88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aea92c-4bb8-44f9-af31-02692a5c88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c46152-507c-400c-9c3a-daf3614913e0', 'volume_name': 'volume-62c46152-507c-400c-9c3a-daf3614913e0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c471a1-5c51-4c4b-bd1b-d1389b5c511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61c471a1-5c51-4c4b-bd1b-d1389b5c511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d16d91-949b-45b0-beeb-8859175a0f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume 62c46152-507c-400c-9c3a-daf3614913e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c46152-507c-400c-9c3a-daf3614913e0', 'volume_size': 1}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:52Z,deleted=False,deleted_at=None,display_description='',display_name='8c47140a-8b23-4671-a0b9-2356257bd284-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c46152-507c-400c-9c3a-daf3614913e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9f0253529845c685afa6cf02f849bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:53Z,use_quota=True,user_id='796f61acef604ddabf2f75d5a62d7867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Creating volume 62c46152-507c-400c-9c3a-daf3614913e0 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:52 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:52 devstack sudo[84911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 1073741824
Apr 08 11:03:52 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "cinder-45337616-2954-4a96-8c6b-ff71a8c5ee44-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-45337616-2954-4a96-8c6b-ff71a8c5ee44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "cinder-quobyte-45337616-2954-4a96-8c6b-ff71a8c5ee44" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-45337616-2954-4a96-8c6b-ff71a8c5ee44" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Deleting offline snapshot 45337616-2954-4a96-8c6b-ff71a8c5ee44 of volume 972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] snapshot_file for this snap is: volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1de2f5f-60d4-4867-ad9f-e6e614af6ea1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:53 devstack sudo[84914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:53 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:53 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 1073741824" returned: 0 in 0.820s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:53 devstack sudo[84918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0
Apr 08 11:03:53 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:53 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.729s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[115e9939-fcf6-4c61-82db-8dc645782be5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:54 devstack sudo[84923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9
Apr 08 11:03:54 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:54 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0" returned: 0 in 0.897s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d16d91-949b-45b0-beeb-8859175a0f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c46152-507c-400c-9c3a-daf3614913e0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cad439-67a4-441e-b8b7-f04b87637957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:54 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume volume-62c46152-507c-400c-9c3a-daf3614913e0 (62c46152-507c-400c-9c3a-daf3614913e0): created successfully
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cad439-67a4-441e-b8b7-f04b87637957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Flow 'volume_create_manager' (d95952eb-b8a7-4289-8fa0-4834e4267bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-efb38072-2702-4822-8b5f-715d30028f8e tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Created volume successfully.
Apr 08 11:03:54 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9" returned: 0 in 0.833s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:54 devstack sudo[84929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:54 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:55 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.636s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:55 devstack sudo[84934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44
Apr 08 11:03:55 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:56 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9.45337616-2954-4a96-8c6b-ff71a8c5ee44" returned: 0 in 0.691s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-45337616-2954-4a96-8c6b-ff71a8c5ee44" released by "_delete_snapshot" :: held 2.998s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_snapshot" :: held 3.030s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Created reservations ['b00b8a58-758e-4257-9dbf-571768a5fb64', '79a5521e-2c46-4b5a-b678-0d3cf67a4b0b', '2af8c0c4-18d6-42cd-bbc5-6712f13279ee', '2b47c8af-a6ee-451b-a6a3-cac0df90264d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e7cbf-1685-4946-add7-932e051a4052]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Delete snapshot completed successfully.
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c286583a-c9a2-4604-b7cb-238125faa39f tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-45337616-2954-4a96-8c6b-ff71a8c5ee44-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:56 devstack sudo[84952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0
Apr 08 11:03:56 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Flow 'volume_create_manager' (e4fddbba-9cf8-41cc-a52b-88a9eeca0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2907bd9-be83-4d84-aff1-dd1c35efc160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2907bd9-be83-4d84-aff1-dd1c35efc160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1883723322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b7c970-68a0-4fc2-98e9-e58b9b15e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43df140e01c04e428fdc2e58e21f1687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:57Z,use_quota=True,user_id='5472ec5456014af29ae7e9018fe295b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9d54c-d1ad-4f7f-bf20-e6335b7f19a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9d54c-d1ad-4f7f-bf20-e6335b7f19a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6847619b-2b29-4f43-a013-e628caf47b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6847619b-2b29-4f43-a013-e628caf47b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b7c970-68a0-4fc2-98e9-e58b9b15e6c4', 'volume_name': 'volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cdc500-4bea-4242-863e-77be47bb5b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cdc500-4bea-4242-863e-77be47bb5b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd1580-a632-4895-bcfd-d0973c492d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:56 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Volume 12b7c970-68a0-4fc2-98e9-e58b9b15e6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4', 'volume_size': 1}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "cinder-972af941-4295-47c2-8ffa-0a9e6c6db7f9-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-972af941-4295-47c2-8ffa-0a9e6c6db7f9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a2724-ecb4-477b-a9b0-3cf992be9a43]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:56 devstack sudo[84954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9
Apr 08 11:03:56 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:57 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0" returned: 0 in 0.720s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.739s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1883723322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b7c970-68a0-4fc2-98e9-e58b9b15e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43df140e01c04e428fdc2e58e21f1687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:03:57Z,use_quota=True,user_id='5472ec5456014af29ae7e9018fe295b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Creating volume 12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:03:57 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd', 'name': 'volume-62c46152-507c-400c-9c3a-daf3614913e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd002bf7c-2146-4f46-9301-da162606fc11', 'enforce_multipath': True} {{(pid=82670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 08 11:03:57 devstack sudo[84959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 1073741824
Apr 08 11:03:57 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:57 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-7766b435-7824-4dff-8a79-511df056543a req-f19acd88-ae0e-4693-a9fd-6162be8a1e46 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] attachment_update completed successfully.
Apr 08 11:03:57 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9" returned: 0 in 0.706s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:57 devstack sudo[84989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9
Apr 08 11:03:57 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:57 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 1073741824" returned: 0 in 0.688s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:57 devstack sudo[84994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4
Apr 08 11:03:57 devstack sudo[84994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:58 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-972af941-4295-47c2-8ffa-0a9e6c6db7f9" returned: 0 in 0.696s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-quobyte-972af941-4295-47c2-8ffa-0a9e6c6db7f9" released by "delete_volume" :: held 1.443s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Created reservations ['196452ed-6145-4306-a768-5c6f667515c1', '081c454c-49ac-47c0-99bc-e0a7cb8d6b9c', '8ddc394f-604d-4814-acd5-d01fe8d89c69', 'fe71806a-fee7-44b3-b960-2290905980ba'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:58 devstack sudo[84997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:03:58 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:58 devstack sudo[84994]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" returned: 0 in 0.707s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd1580-a632-4895-bcfd-d0973c492d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb0170e-0f5e-48d5-aecf-3890f1a2b9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:03:58 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Volume volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 (12b7c970-68a0-4fc2-98e9-e58b9b15e6c4): created successfully
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb0170e-0f5e-48d5-aecf-3890f1a2b9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Flow 'volume_create_manager' (e4fddbba-9cf8-41cc-a52b-88a9eeca0191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:03:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-421704e3-89e3-44b5-927c-2ffffa2b3830 tempest-VolumesServicesTestJSON-1147579382 None] Created volume successfully.
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Acquiring lock "cinder-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "cinder-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Acquiring lock "cinder-quobyte-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "cinder-quobyte-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b397551-6a7b-4d20-827a-9cc834e920f2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:03:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:59 devstack sudo[85001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4
Apr 08 11:03:59 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:03:59 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.703s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:59 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:03:59 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Deleted volume successfully.
Apr 08 11:03:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-13c5bdcd-fef2-4e4b-88f2-9bb4a4359ebf tempest-SnapshotsActionsTest-844207604 None] Lock "cinder-972af941-4295-47c2-8ffa-0a9e6c6db7f9-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:03:59 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root
Apr 08 11:03:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" returned: 0 in 0.818s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:03:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:03:59 devstack sudo[85073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4
Apr 08 11:03:59 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:00 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" returned: 0 in 0.671s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "cinder-quobyte-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4" released by "delete_volume" :: held 1.520s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Created reservations ['fb379a71-5d3a-47d4-b410-1f8bba051dc5', 'a7e5242b-6395-44f5-ab97-9e937e0e6869', '031d46d6-560e-4e2a-bdb4-754944db0b8c', '364e0c4f-1322-4532-971e-2157be5e4e72'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:00 devstack sudo[85079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:00 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Flow 'volume_create_manager' (3c2f4219-1b31-4633-9efa-9e63e9e8ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b29bf-91bf-474c-90e4-a5d975e27173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692b29bf-91bf-474c-90e4-a5d975e27173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-275966979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25815647-21b5-45bb-9d80-99b58f6ba5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35388490a7cf4d56942cb9cd08acd9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:01Z,use_quota=True,user_id='b10ad7d01cf1484e84a0ee38c5799de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722fbb91-0bbf-4c35-b220-bd298b782782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722fbb91-0bbf-4c35-b220-bd298b782782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec78fd5a-5515-4650-9773-bf0690d83227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec78fd5a-5515-4650-9773-bf0690d83227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25815647-21b5-45bb-9d80-99b58f6ba5e3', 'volume_name': 'volume-25815647-21b5-45bb-9d80-99b58f6ba5e3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f05f33-5d49-4d43-bee9-f9fe575461d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f05f33-5d49-4d43-bee9-f9fe575461d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965f862c-8528-408c-bb4a-046275ea6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Volume 25815647-21b5-45bb-9d80-99b58f6ba5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25815647-21b5-45bb-9d80-99b58f6ba5e3', 'volume_size': 1}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-275966979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25815647-21b5-45bb-9d80-99b58f6ba5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35388490a7cf4d56942cb9cd08acd9c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:01Z,use_quota=True,user_id='b10ad7d01cf1484e84a0ee38c5799de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Creating volume 25815647-21b5-45bb-9d80-99b58f6ba5e3 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:01 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:01 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 1073741824
Apr 08 11:04:01 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:01 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.609s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:01 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Deleted volume successfully.
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-af82238b-7053-4e4c-98d0-606f179f495e tempest-VolumesServicesTestJSON-1147579382 None] Lock "cinder-12b7c970-68a0-4fc2-98e9-e58b9b15e6c4-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:01 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 1073741824" returned: 0 in 0.682s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:01 devstack sudo[85088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3
Apr 08 11:04:01 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:02 devstack sudo[85428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:02 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:02 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3" returned: 0 in 1.154s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965f862c-8528-408c-bb4a-046275ea6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25815647-21b5-45bb-9d80-99b58f6ba5e3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20b6f5c-e81c-4316-bfe1-83324c9da6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Volume volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 (25815647-21b5-45bb-9d80-99b58f6ba5e3): created successfully
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20b6f5c-e81c-4316-bfe1-83324c9da6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Flow 'volume_create_manager' (3c2f4219-1b31-4633-9efa-9e63e9e8ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:03 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0f5a0acd-30d7-4ed9-882d-804cc4461890 tempest-AbsoluteLimitsTests-1463027202 None] Created volume successfully.
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Acquiring lock "cinder-25815647-21b5-45bb-9d80-99b58f6ba5e3-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "cinder-25815647-21b5-45bb-9d80-99b58f6ba5e3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Acquiring lock "cinder-quobyte-25815647-21b5-45bb-9d80-99b58f6ba5e3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "cinder-quobyte-25815647-21b5-45bb-9d80-99b58f6ba5e3" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[70942092-8471-4f37-bad3-6e07f0a4e499]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:03 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3
Apr 08 11:04:03 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:03 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 1.171s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Flow 'volume_create_manager' (a402a52b-826e-40cc-a75c-646b0090da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a0b395-184c-4152-a254-0a39d65e119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a0b395-184c-4152-a254-0a39d65e119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1793168322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef73a3-f1cb-4629-afeb-f9196aaaada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8bf0b0a6394eb9b99e714760f22a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:04Z,use_quota=True,user_id='88a13baeff394f4faa042df1e27f6e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5f08f0-cf35-46c6-bd20-d9e02c26b416),volume_type_id=2b5f08f0-cf35-46c6-bd20-d9e02c26b416)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde24198-a2ee-4f63-a828-e9eef7dbf975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde24198-a2ee-4f63-a828-e9eef7dbf975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6fe805-b92b-4e3e-986f-e9bf28e8094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6fe805-b92b-4e3e-986f-e9bf28e8094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ef73a3-f1cb-4629-afeb-f9196aaaada8', 'volume_name': 'volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7063b5-9a7c-4cbe-9a7b-6e326cf35fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7063b5-9a7c-4cbe-9a7b-6e326cf35fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc28d05d-1309-408b-9e11-f0868a22183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:03 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Volume 28ef73a3-f1cb-4629-afeb-f9196aaaada8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8', 'volume_size': 1}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1793168322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef73a3-f1cb-4629-afeb-f9196aaaada8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b8bf0b0a6394eb9b99e714760f22a07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:04Z,use_quota=True,user_id='88a13baeff394f4faa042df1e27f6e86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b5f08f0-cf35-46c6-bd20-d9e02c26b416),volume_type_id=2b5f08f0-cf35-46c6-bd20-d9e02c26b416)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Creating volume 28ef73a3-f1cb-4629-afeb-f9196aaaada8 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:03 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:03 devstack sudo[85436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 1073741824
Apr 08 11:04:03 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:04 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3" returned: 0 in 0.722s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:04 devstack sudo[85441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3
Apr 08 11:04:04 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:04 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 1073741824" returned: 0 in 0.760s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:04 devstack sudo[85447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8
Apr 08 11:04:04 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:04 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-25815647-21b5-45bb-9d80-99b58f6ba5e3" returned: 0 in 0.716s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "cinder-quobyte-25815647-21b5-45bb-9d80-99b58f6ba5e3" released by "delete_volume" :: held 1.486s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Created reservations ['0b988a7e-3211-4aab-a101-60c8c3aab308', 'b8491e11-b446-4965-a071-e2a919314696', 'f8c2d1f8-fbe5-492e-a583-fac99eefefbe', '8bf86483-ee1a-4921-984c-a646832d69ac'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:05 devstack sudo[85450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:05 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:05 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8" returned: 0 in 0.657s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc28d05d-1309-408b-9e11-f0868a22183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb3119-e2ac-4afb-984d-0d235d680dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:05 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Volume volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 (28ef73a3-f1cb-4629-afeb-f9196aaaada8): created successfully
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ccb3119-e2ac-4afb-984d-0d235d680dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Flow 'volume_create_manager' (a402a52b-826e-40cc-a75c-646b0090da8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f8e90b59-6fa3-489b-b458-acaa2150d367 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Created volume successfully.
Apr 08 11:04:05 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.710s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Deleted volume successfully.
Apr 08 11:04:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-66c04a6f-aa25-44f3-9981-10a3fa560042 tempest-AbsoluteLimitsTests-1463027202 None] Lock "cinder-25815647-21b5-45bb-9d80-99b58f6ba5e3-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:06 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:06 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Flow 'volume_create_manager' (468d72d6-f5b2-4dae-8bb2-06cbe2f3cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2ac7fd-53b9-4eef-b2dc-2a2f0566c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2ac7fd-53b9-4eef-b2dc-2a2f0566c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-286546031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc34b9a-3005-48eb-b13f-ec455e34a744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6162c3e96b4e089d90cd5e6676c58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:07Z,use_quota=True,user_id='27fa5cd626f34a6a861e5aecd9aa912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e99024-9d27-432e-af0e-8a13e0a81a1c),volume_type_id=43e99024-9d27-432e-af0e-8a13e0a81a1c)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d29173-6aa1-413d-9aa7-1a144abf85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d29173-6aa1-413d-9aa7-1a144abf85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffa625c-0969-48f6-b29c-b2f793af375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ffa625c-0969-48f6-b29c-b2f793af375e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc34b9a-3005-48eb-b13f-ec455e34a744', 'volume_name': 'volume-7cc34b9a-3005-48eb-b13f-ec455e34a744', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b72e4a2-c387-4976-962d-f93491731659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b72e4a2-c387-4976-962d-f93491731659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5ef51d-6bd5-41cb-a304-442f37d3252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:06 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Volume 7cc34b9a-3005-48eb-b13f-ec455e34a744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc34b9a-3005-48eb-b13f-ec455e34a744', 'volume_size': 1}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-286546031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc34b9a-3005-48eb-b13f-ec455e34a744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6162c3e96b4e089d90cd5e6676c58f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:07Z,use_quota=True,user_id='27fa5cd626f34a6a861e5aecd9aa912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43e99024-9d27-432e-af0e-8a13e0a81a1c),volume_type_id=43e99024-9d27-432e-af0e-8a13e0a81a1c)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Creating volume 7cc34b9a-3005-48eb-b13f-ec455e34a744 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:06 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:06 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 1073741824
Apr 08 11:04:06 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:06 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.415s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:06 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-37faf27f-2c8d-4f90-9098-774623a09b1d tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Retype volume completed successfully.
Apr 08 11:04:07 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 1073741824" returned: 0 in 0.724s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:07 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744
Apr 08 11:04:07 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "cinder-28ef73a3-f1cb-4629-afeb-f9196aaaada8-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "cinder-28ef73a3-f1cb-4629-afeb-f9196aaaada8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "cinder-quobyte-28ef73a3-f1cb-4629-afeb-f9196aaaada8" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "cinder-quobyte-28ef73a3-f1cb-4629-afeb-f9196aaaada8" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2841c6-af5d-4c4b-96be-7612ac71121a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:07 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744" returned: 0 in 0.509s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:07 devstack sudo[85466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5ef51d-6bd5-41cb-a304-442f37d3252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc34b9a-3005-48eb-b13f-ec455e34a744', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:07 devstack sudo[85466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61837f4-5e62-432c-8501-d6f9cc204a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:07 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Volume volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 (7cc34b9a-3005-48eb-b13f-ec455e34a744): created successfully
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61837f4-5e62-432c-8501-d6f9cc204a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Flow 'volume_create_manager' (468d72d6-f5b2-4dae-8bb2-06cbe2f3cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-43747b3b-b8a1-417b-81d0-6050661af958 tempest-VolumeTypesAccessTest-1490480796 None] Created volume successfully.
Apr 08 11:04:08 devstack sudo[85466]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8" returned: 0 in 0.504s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:08 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8
Apr 08 11:04:08 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Acquiring lock "cinder-7cc34b9a-3005-48eb-b13f-ec455e34a744-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "cinder-7cc34b9a-3005-48eb-b13f-ec455e34a744-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Acquiring lock "cinder-quobyte-7cc34b9a-3005-48eb-b13f-ec455e34a744" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "cinder-quobyte-7cc34b9a-3005-48eb-b13f-ec455e34a744" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe3c51-a26d-46cd-9172-4def49c24ecb]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:08 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-28ef73a3-f1cb-4629-afeb-f9196aaaada8" returned: 0 in 0.528s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "cinder-quobyte-28ef73a3-f1cb-4629-afeb-f9196aaaada8" released by "delete_volume" :: held 1.067s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:08 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744
Apr 08 11:04:08 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:08 devstack cinder-volume[82670]: WARNING cinder.quota [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:04:08 devstack cinder-volume[82670]: WARNING cinder.quota [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Created reservations ['f801d866-ab93-43f0-b09f-cef6a2015d24', 'd89765cd-557a-4fdd-84e3-05dbae650175', 'a8d2c1bb-052b-40fd-ac0e-ef5138cb41c2', '28f2eeb1-e7d8-4b80-a055-68bbffcd6131'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:08 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:08 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:09 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744" returned: 0 in 0.564s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:09 devstack sudo[85482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744
Apr 08 11:04:09 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Flow 'volume_create_manager' (65ed3cf9-b63d-409e-a45e-0394b9f9de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca19ff1-7117-4746-86b3-b9b64fa7624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca19ff1-7117-4746-86b3-b9b64fa7624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1279250277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2b699-da00-400b-b3b4-55919b06aa8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528ea77e17804d9fa60d1bd77caed0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:09Z,use_quota=True,user_id='2fa72a7110d14629951e4754f820cee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0159461a-0866-40a2-90ba-8fc2b62a6f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0159461a-0866-40a2-90ba-8fc2b62a6f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b246c0f5-769c-44fd-b468-c7b3ba07a1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:09 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b246c0f5-769c-44fd-b468-c7b3ba07a1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c2b699-da00-400b-b3b4-55919b06aa8e', 'volume_name': 'volume-d2c2b699-da00-400b-b3b4-55919b06aa8e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37227377-5b52-4fb9-9f52-e334d259e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37227377-5b52-4fb9-9f52-e334d259e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919d3142-b321-4dac-9ddc-7e1f2923202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:09 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Volume d2c2b699-da00-400b-b3b4-55919b06aa8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c2b699-da00-400b-b3b4-55919b06aa8e', 'volume_size': 1}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1279250277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c2b699-da00-400b-b3b4-55919b06aa8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528ea77e17804d9fa60d1bd77caed0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:09Z,use_quota=True,user_id='2fa72a7110d14629951e4754f820cee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Creating volume d2c2b699-da00-400b-b3b4-55919b06aa8e {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:09 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Deleted volume successfully.
Apr 08 11:04:09 devstack sudo[85490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e 1073741824
Apr 08 11:04:09 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5dadd27d-4741-477e-8674-bd0128102127 tempest-VolumeRetypeWithoutMigrationTest-748312409 None] Lock "cinder-28ef73a3-f1cb-4629-afeb-f9196aaaada8-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:09 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7cc34b9a-3005-48eb-b13f-ec455e34a744" returned: 0 in 0.575s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "cinder-quobyte-7cc34b9a-3005-48eb-b13f-ec455e34a744" released by "delete_volume" :: held 1.161s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:09 devstack cinder-volume[82670]: WARNING cinder.quota [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2064167390 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2064167390, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:04:09 devstack cinder-volume[82670]: WARNING cinder.quota [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2064167390 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2064167390, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:04:09 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Created reservations ['c84bb8f6-64b5-4c26-a085-615f621c16f1', 'c0927a36-79bc-4acd-b038-167f91619421', 'd423e1c4-c07a-4e7e-9ee6-2a5324554d79', '54132ba2-6a18-4921-9b9c-5fcb332d7b28'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:10 devstack sudo[85517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:10 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:10 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e 1073741824" returned: 0 in 0.625s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:10 devstack sudo[85519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e
Apr 08 11:04:10 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:10 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Deleted volume successfully.
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddbc93c8-6b08-470e-ab04-9ee6b56ef2a7 tempest-VolumeTypesAccessTest-1490480796 None] Lock "cinder-7cc34b9a-3005-48eb-b13f-ec455e34a744-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:10 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e" returned: 0 in 0.518s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919d3142-b321-4dac-9ddc-7e1f2923202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c2b699-da00-400b-b3b4-55919b06aa8e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844710f8-4fc9-4572-afee-388a38f589de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:10 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Volume volume-d2c2b699-da00-400b-b3b4-55919b06aa8e (d2c2b699-da00-400b-b3b4-55919b06aa8e): created successfully
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844710f8-4fc9-4572-afee-388a38f589de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Flow 'volume_create_manager' (65ed3cf9-b63d-409e-a45e-0394b9f9de27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4174854d-eae5-45e6-af3d-c355ae295867 tempest-VolumesTransfersTest-1906562052 None] Created volume successfully.
Apr 08 11:04:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1c030e51-47ec-4026-98aa-ebef436d1aff tempest-VolumesTransfersTest-802945037 None] Transfer volume completed successfully.
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "cinder-d2c2b699-da00-400b-b3b4-55919b06aa8e-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-d2c2b699-da00-400b-b3b4-55919b06aa8e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "cinder-quobyte-d2c2b699-da00-400b-b3b4-55919b06aa8e" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-quobyte-d2c2b699-da00-400b-b3b4-55919b06aa8e" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424a529-aa2a-4e30-ae3d-22eca9fe1727]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:13 devstack sudo[85545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e
Apr 08 11:04:13 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:13 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e" returned: 0 in 0.661s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:13 devstack sudo[85550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e
Apr 08 11:04:13 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:14 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d2c2b699-da00-400b-b3b4-55919b06aa8e" returned: 0 in 0.518s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-quobyte-d2c2b699-da00-400b-b3b4-55919b06aa8e" released by "delete_volume" :: held 1.213s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Created reservations ['d6cf73d9-ef5e-4d05-8ed3-43da1c075203', '2c4fec6f-3c16-4d8a-8e9e-5bc1c5126fc1', 'e386dd6a-2424-4d12-b117-ff8264be4829', 'a21211f1-6328-45b4-96cc-4f5d9e2fe284'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:14 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:14 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:14 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.550s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:14 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:15 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Deleted volume successfully.
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0f0a570-803c-4fb7-97a4-1dc5249eb599 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-d2c2b699-da00-400b-b3b4-55919b06aa8e-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Flow 'volume_create_manager' (661bf653-3f98-4a9e-a17b-a24789230469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d82c3-655a-4a01-8b89-9bcb722ca6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0d82c3-655a-4a01-8b89-9bcb722ca6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1149265680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca63c37-1f4b-476c-bba2-3a9870886335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528ea77e17804d9fa60d1bd77caed0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:16Z,use_quota=True,user_id='2fa72a7110d14629951e4754f820cee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3d717f-532d-4485-afa2-26a1a1e17c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3d717f-532d-4485-afa2-26a1a1e17c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504570cc-e461-4953-831f-c3b35c8b0c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504570cc-e461-4953-831f-c3b35c8b0c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca63c37-1f4b-476c-bba2-3a9870886335', 'volume_name': 'volume-0ca63c37-1f4b-476c-bba2-3a9870886335', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2320560-b4f2-4a80-b430-1e124b8e1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2320560-b4f2-4a80-b430-1e124b8e1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c5655c-e2eb-4ff3-8154-6b770e99b3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Volume 0ca63c37-1f4b-476c-bba2-3a9870886335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca63c37-1f4b-476c-bba2-3a9870886335', 'volume_size': 1}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1149265680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca63c37-1f4b-476c-bba2-3a9870886335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528ea77e17804d9fa60d1bd77caed0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:16Z,use_quota=True,user_id='2fa72a7110d14629951e4754f820cee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Creating volume 0ca63c37-1f4b-476c-bba2-3a9870886335 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:15 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:15 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 1073741824
Apr 08 11:04:15 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Flow 'volume_create_manager' (7d81e8f6-4d0e-4385-a0e4-65a6dd49c979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f899e-e53c-46ce-a08a-4e65c9c47d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626f899e-e53c-46ce-a08a-4e65c9c47d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-6374494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1788f2dc-7511-40f3-9a44-0ab5c33e7521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59a9e02305741bfb34cf87d9cadde88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:16Z,use_quota=True,user_id='aeea3ca2704845d092eb2f435be2bd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a3f4b-97fa-4a59-948a-61d55a148a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a3f4b-97fa-4a59-948a-61d55a148a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6ad48e-1f6c-4e78-bb69-7dfd153516bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6ad48e-1f6c-4e78-bb69-7dfd153516bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1788f2dc-7511-40f3-9a44-0ab5c33e7521', 'volume_name': 'volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a554b971-c46c-45a7-a48f-0f95557a08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a554b971-c46c-45a7-a48f-0f95557a08e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1357730e-d687-4e61-abec-8df4b55e7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Volume 1788f2dc-7511-40f3-9a44-0ab5c33e7521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521', 'volume_size': 1}
Apr 08 11:04:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:16 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 1073741824" returned: 0 in 0.937s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:16 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335
Apr 08 11:04:16 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:17 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335" returned: 0 in 0.485s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-6374494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1788f2dc-7511-40f3-9a44-0ab5c33e7521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59a9e02305741bfb34cf87d9cadde88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:16Z,use_quota=True,user_id='aeea3ca2704845d092eb2f435be2bd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Creating volume 1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:17 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c5655c-e2eb-4ff3-8154-6b770e99b3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca63c37-1f4b-476c-bba2-3a9870886335', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e79970-8d1f-4c7f-9d42-db67dad96903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:17 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 1073741824
Apr 08 11:04:17 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:17 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Volume volume-0ca63c37-1f4b-476c-bba2-3a9870886335 (0ca63c37-1f4b-476c-bba2-3a9870886335): created successfully
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e79970-8d1f-4c7f-9d42-db67dad96903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Flow 'volume_create_manager' (661bf653-3f98-4a9e-a17b-a24789230469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7fbb4df2-3f84-4b04-9163-4fc390160257 tempest-VolumesTransfersTest-1906562052 None] Created volume successfully.
Apr 08 11:04:17 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 1073741824" returned: 0 in 0.692s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:17 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521
Apr 08 11:04:17 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "cinder-0ca63c37-1f4b-476c-bba2-3a9870886335-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-0ca63c37-1f4b-476c-bba2-3a9870886335-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "cinder-quobyte-0ca63c37-1f4b-476c-bba2-3a9870886335" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-quobyte-0ca63c37-1f4b-476c-bba2-3a9870886335" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce3025f-aa80-4e70-9756-6d6253a567f2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:18 devstack sudo[85603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335
Apr 08 11:04:18 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:18 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521" returned: 0 in 0.641s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1357730e-d687-4e61-abec-8df4b55e7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf4421-8899-4073-ada1-6a3b8b6925f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Volume volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 (1788f2dc-7511-40f3-9a44-0ab5c33e7521): created successfully
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf4421-8899-4073-ada1-6a3b8b6925f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Flow 'volume_create_manager' (7d81e8f6-4d0e-4385-a0e4-65a6dd49c979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c1059379-890c-4124-9676-9218f479b548 tempest-SnapshotMetadataTestJSON-1202233580 None] Created volume successfully.
Apr 08 11:04:18 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335" returned: 0 in 0.559s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:18 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335
Apr 08 11:04:18 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Creating offline snapshot 6b611062-734c-4e65-a8ef-15658fded5fd of volume 1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a591d-dd91-477f-82b8-aae3d72421a5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:19 devstack sudo[85611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521
Apr 08 11:04:19 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:19 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0ca63c37-1f4b-476c-bba2-3a9870886335" returned: 0 in 0.871s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-quobyte-0ca63c37-1f4b-476c-bba2-3a9870886335" released by "delete_volume" :: held 1.480s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Created reservations ['257075da-b7d6-44fe-9b47-0a08a1fc8441', '841499f6-d77c-4367-a5c3-40d7e95aceb5', '44720888-35c8-489c-9804-4ce7aa232d1e', 'e29dafab-4a60-46da-b543-19064d8d99cb'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:19 devstack sudo[85638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:19 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:19 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521" returned: 0 in 0.889s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:19 devstack sudo[85643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd 1G
Apr 08 11:04:19 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:20 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:20 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Deleted volume successfully.
Apr 08 11:04:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-489000ce-7c14-4e37-8666-286de50179f4 tempest-VolumesTransfersTest-1882901642 None] Lock "cinder-0ca63c37-1f4b-476c-bba2-3a9870886335-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:20 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd 1G" returned: 0 in 0.657s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:20 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd
Apr 08 11:04:20 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:21 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd" returned: 0 in 0.828s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:21 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd is being set with open permissions: ugo+rw
Apr 08 11:04:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:21 devstack sudo[85699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd
Apr 08 11:04:21 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:22 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd" returned: 0 in 0.672s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:22 devstack sudo[85706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info
Apr 08 11:04:22 devstack sudo[85706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:22 devstack sudo[85706]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info" returned: 0 in 0.557s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:22 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info is being set with open permissions: ugo+rw
Apr 08 11:04:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:22 devstack sudo[85709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info
Apr 08 11:04:22 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:23 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.info" returned: 0 in 0.551s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f6dd91b7-81fb-41fe-b31f-3772518ad85e tempest-SnapshotMetadataTestJSON-1202233580 None] Create snapshot completed successfully
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "cinder-6b611062-734c-4e65-a8ef-15658fded5fd-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-6b611062-734c-4e65-a8ef-15658fded5fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "cinder-quobyte-6b611062-734c-4e65-a8ef-15658fded5fd" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-6b611062-734c-4e65-a8ef-15658fded5fd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Deleting offline snapshot 6b611062-734c-4e65-a8ef-15658fded5fd of volume 1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] snapshot_file for this snap is: volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5354ad4-b059-4820-a20a-d5df0c6bee98]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:25 devstack sudo[85719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd
Apr 08 11:04:25 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:25 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd" returned: 0 in 0.616s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:04:25 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b083d5-e51c-4bdd-ae22-e449a7f2ac78]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:25 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521
Apr 08 11:04:25 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:26 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Flow 'volume_create_manager' (e26df877-0189-42aa-94aa-1257e65182a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62200c76-d17a-4ba0-9727-ed2863f4015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521" returned: 0 in 0.600s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62200c76-d17a-4ba0-9727-ed2863f4015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-544918889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c25b354-c478-4c96-8223-9aef4f5abaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce19ca6a5e0a41c48c13586a5325c65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:26Z,use_quota=True,user_id='7100d29ef72c4007a4559c7cbf11d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7f8e42-1247-4adf-b7dc-6eafe2a5f474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:26 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd
Apr 08 11:04:26 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7f8e42-1247-4adf-b7dc-6eafe2a5f474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eaeac3-5128-47e4-ab17-6d977c039650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80eaeac3-5128-47e4-ab17-6d977c039650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c25b354-c478-4c96-8223-9aef4f5abaf3', 'volume_name': 'volume-8c25b354-c478-4c96-8223-9aef4f5abaf3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae49c133-4909-468a-8e5e-9b43e58070d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae49c133-4909-468a-8e5e-9b43e58070d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e93699e-b491-47c0-ad54-69a65a0a3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:26 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Volume 8c25b354-c478-4c96-8223-9aef4f5abaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c25b354-c478-4c96-8223-9aef4f5abaf3', 'volume_size': 1}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-544918889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c25b354-c478-4c96-8223-9aef4f5abaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce19ca6a5e0a41c48c13586a5325c65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:26Z,use_quota=True,user_id='7100d29ef72c4007a4559c7cbf11d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Creating volume 8c25b354-c478-4c96-8223-9aef4f5abaf3 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:26 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:26 devstack sudo[85731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 1073741824
Apr 08 11:04:26 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:26 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd" returned: 0 in 0.556s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:26 devstack sudo[85739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd
Apr 08 11:04:26 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:26 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 1073741824" returned: 0 in 0.579s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:26 devstack sudo[85741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3
Apr 08 11:04:26 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:27 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521.6b611062-734c-4e65-a8ef-15658fded5fd" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-6b611062-734c-4e65-a8ef-15658fded5fd" released by "_delete_snapshot" :: held 2.341s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" released by "delete_snapshot" :: held 2.366s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Created reservations ['71c1c86a-f50d-41ac-aa83-c0645ab9f0d6', 'f81e470a-0a35-4b45-8c33-8eebcd7805b2', 'cd04ac53-324c-4469-ab7b-50b5f3ada6c7', '20be9a61-944d-4352-b4f9-49efe8d78197'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Delete snapshot completed successfully.
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-268f42ef-504f-4e9b-a59f-05d5795c6e0e tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-6b611062-734c-4e65-a8ef-15658fded5fd-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:27 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3" returned: 0 in 0.515s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e93699e-b491-47c0-ad54-69a65a0a3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c25b354-c478-4c96-8223-9aef4f5abaf3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eb6327-c951-43e4-b737-89d968719a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:27 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Volume volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 (8c25b354-c478-4c96-8223-9aef4f5abaf3): created successfully
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69eb6327-c951-43e4-b737-89d968719a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Flow 'volume_create_manager' (e26df877-0189-42aa-94aa-1257e65182a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9c38683d-ee51-4906-8056-1e634e4241d5 tempest-VolumesTransfersV355Test-194362747 None] Created volume successfully.
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "cinder-1788f2dc-7511-40f3-9a44-0ab5c33e7521-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-1788f2dc-7511-40f3-9a44-0ab5c33e7521-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fb29af-0742-4a7e-a165-e026e5774766]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:28 devstack sudo[85745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521
Apr 08 11:04:28 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-83e342a0-507c-49de-a6c4-9eb3db7df695 tempest-VolumesTransfersV355Test-801340478 None] Transfer volume completed successfully.
Apr 08 11:04:28 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521" returned: 0 in 0.669s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:28 devstack sudo[85751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521
Apr 08 11:04:28 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:29 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1788f2dc-7511-40f3-9a44-0ab5c33e7521" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-quobyte-1788f2dc-7511-40f3-9a44-0ab5c33e7521" released by "delete_volume" :: held 1.207s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Created reservations ['e7269b31-63d7-42fe-96f9-a5fac82eebbb', 'db4ecf46-8723-4e2e-b7c7-af7ce0798906', '3f37fdfe-61dc-46c5-8c2a-062a122933a3', 'd89a731a-f51c-44f9-a865-ad929a15adf5'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:29 devstack sudo[85754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:29 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "cinder-8c25b354-c478-4c96-8223-9aef4f5abaf3-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-8c25b354-c478-4c96-8223-9aef4f5abaf3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "cinder-quobyte-8c25b354-c478-4c96-8223-9aef4f5abaf3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-quobyte-8c25b354-c478-4c96-8223-9aef4f5abaf3" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fac724-31d4-4409-b62f-6b4b3d429819]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:29 devstack sudo[85762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3
Apr 08 11:04:29 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:30 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.684s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:30 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Deleted volume successfully.
Apr 08 11:04:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4052e166-6759-4466-9c26-be044a05f11a tempest-SnapshotMetadataTestJSON-1202233580 None] Lock "cinder-1788f2dc-7511-40f3-9a44-0ab5c33e7521-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:30 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3" returned: 0 in 0.662s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:30 devstack sudo[85768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3
Apr 08 11:04:30 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:31 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8c25b354-c478-4c96-8223-9aef4f5abaf3" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-quobyte-8c25b354-c478-4c96-8223-9aef4f5abaf3" released by "delete_volume" :: held 1.279s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Created reservations ['12795265-0324-4b02-b47b-288e7d3bf00c', '2a9a6acc-043e-4959-8f48-f4c6dd121a84', '515874b2-faf5-41a2-8610-3fb25ebe015b', '6c1aff4c-7f9f-4df6-a622-cb4905a1d7cd'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:31 devstack sudo[85784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:31 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:31 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Deleted volume successfully.
Apr 08 11:04:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-044e47cd-3996-4d53-b3cc-8589aeb68956 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-8c25b354-c478-4c96-8223-9aef4f5abaf3-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Flow 'volume_create_manager' (54c9146f-ac6f-43d5-8c1c-680737a9cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e78fcee-89f9-49df-98ca-2da17f7517d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e78fcee-89f9-49df-98ca-2da17f7517d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-176536522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578a867c-a1d0-49ca-bda4-43a4b8651047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce19ca6a5e0a41c48c13586a5325c65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:32Z,use_quota=True,user_id='7100d29ef72c4007a4559c7cbf11d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb8704-add0-4b3c-93ef-4d7542eef2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fb8704-add0-4b3c-93ef-4d7542eef2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ecbef-f4cf-41bf-8d2c-9c31ad931a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746ecbef-f4cf-41bf-8d2c-9c31ad931a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578a867c-a1d0-49ca-bda4-43a4b8651047', 'volume_name': 'volume-578a867c-a1d0-49ca-bda4-43a4b8651047', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4215bb0-ab34-442d-a1f6-2713a29239d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4215bb0-ab34-442d-a1f6-2713a29239d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81344690-4b10-4eb6-b23f-9591593fc5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Volume 578a867c-a1d0-49ca-bda4-43a4b8651047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578a867c-a1d0-49ca-bda4-43a4b8651047', 'volume_size': 1}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-176536522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578a867c-a1d0-49ca-bda4-43a4b8651047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce19ca6a5e0a41c48c13586a5325c65b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:32Z,use_quota=True,user_id='7100d29ef72c4007a4559c7cbf11d1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Creating volume 578a867c-a1d0-49ca-bda4-43a4b8651047 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:32 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:32 devstack sudo[85790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 1073741824
Apr 08 11:04:32 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:33 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 1073741824" returned: 0 in 0.743s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:UPDATE=197,cinder:SELECT=164,cinder:DELETE=17,cinder:INSERT=44 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:33 devstack sudo[85798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047
Apr 08 11:04:33 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:33 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047" returned: 0 in 0.602s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=145,cinder:UPDATE=185,cinder:INSERT=48,cinder:DELETE=10 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81344690-4b10-4eb6-b23f-9591593fc5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578a867c-a1d0-49ca-bda4-43a4b8651047', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495c155f-f2c4-4f9d-aa5e-aad933778d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:33 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Volume volume-578a867c-a1d0-49ca-bda4-43a4b8651047 (578a867c-a1d0-49ca-bda4-43a4b8651047): created successfully
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495c155f-f2c4-4f9d-aa5e-aad933778d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Flow 'volume_create_manager' (54c9146f-ac6f-43d5-8c1c-680737a9cc44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2f257cad-3517-4111-9a7a-e4cc605d76b5 tempest-VolumesTransfersV355Test-194362747 None] Created volume successfully.
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "cinder-578a867c-a1d0-49ca-bda4-43a4b8651047-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-578a867c-a1d0-49ca-bda4-43a4b8651047-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "cinder-quobyte-578a867c-a1d0-49ca-bda4-43a4b8651047" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-quobyte-578a867c-a1d0-49ca-bda4-43a4b8651047" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd0f0d1-015b-4f99-9ca8-35c5e396d9b6]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:34 devstack sudo[85802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047
Apr 08 11:04:34 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Flow 'volume_create_manager' (bd0a4ed3-7a9a-4ddb-9d85-a3e5c5fdb3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d2eb1-0ae3-460d-9acd-b1f75ff9f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5d2eb1-0ae3-460d-9acd-b1f75ff9f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475001949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b556a5-f9df-4870-9682-b691e24f9d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843af4857b8b471c9a6ad44e4f732762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:35Z,use_quota=True,user_id='81c218579fa844faa345b298677bdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d766ff-eb3d-4b16-bcc6-747dc1cf1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d766ff-eb3d-4b16-bcc6-747dc1cf1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c314ebf-459b-41a1-b7f1-988972c05ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c314ebf-459b-41a1-b7f1-988972c05ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b556a5-f9df-4870-9682-b691e24f9d64', 'volume_name': 'volume-a7b556a5-f9df-4870-9682-b691e24f9d64', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f67fb4-1df9-408a-ad9e-dfb06f0737a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f67fb4-1df9-408a-ad9e-dfb06f0737a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05691cba-6d24-4f95-9366-de37980aa924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Volume a7b556a5-f9df-4870-9682-b691e24f9d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b556a5-f9df-4870-9682-b691e24f9d64', 'volume_size': 1}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475001949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b556a5-f9df-4870-9682-b691e24f9d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843af4857b8b471c9a6ad44e4f732762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:35Z,use_quota=True,user_id='81c218579fa844faa345b298677bdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Creating volume a7b556a5-f9df-4870-9682-b691e24f9d64 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:35 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:35 devstack sudo[85807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 1073741824
Apr 08 11:04:35 devstack sudo[85807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:35 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047" returned: 0 in 0.584s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:35 devstack sudo[85812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047
Apr 08 11:04:35 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:35 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-578a867c-a1d0-49ca-bda4-43a4b8651047" returned: 0 in 0.514s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-quobyte-578a867c-a1d0-49ca-bda4-43a4b8651047" released by "delete_volume" :: held 1.133s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Created reservations ['0c9e9e70-fc32-441e-9ebe-e22845132600', 'f6c91187-a37a-41b5-a8e9-d26cf51c795f', 'e6fab724-3aeb-4180-90f2-c0942b3bbe19', 'f74c5297-cfdd-4b40-bbfa-6a738b81a45c'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:36 devstack sudo[85807]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 1073741824" returned: 0 in 0.744s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:36 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64
Apr 08 11:04:36 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:36 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:36 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:36 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:36 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05691cba-6d24-4f95-9366-de37980aa924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b556a5-f9df-4870-9682-b691e24f9d64', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c1cff0-2acb-407d-8445-6135ba94c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:36 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Volume volume-a7b556a5-f9df-4870-9682-b691e24f9d64 (a7b556a5-f9df-4870-9682-b691e24f9d64): created successfully
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84c1cff0-2acb-407d-8445-6135ba94c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Flow 'volume_create_manager' (bd0a4ed3-7a9a-4ddb-9d85-a3e5c5fdb3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Deleted volume successfully.
Apr 08 11:04:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-638cf04a-5ab0-447f-8ba9-4b59501bb11c tempest-VolumesTransfersV357Test-685208393 None] Created volume successfully.
Apr 08 11:04:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe6eccfa-e3c8-4972-a717-e858b0a705f6 tempest-VolumesTransfersV355Test-1433831576 None] Lock "cinder-578a867c-a1d0-49ca-bda4-43a4b8651047-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dcadca43-fc22-4a9d-afb8-c8b91268cb6e tempest-VolumesTransfersV357Test-1059976911 None] Transfer volume completed successfully.
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "cinder-a7b556a5-f9df-4870-9682-b691e24f9d64-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-a7b556a5-f9df-4870-9682-b691e24f9d64-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "cinder-quobyte-a7b556a5-f9df-4870-9682-b691e24f9d64" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-quobyte-a7b556a5-f9df-4870-9682-b691e24f9d64" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceea997-2b64-4d88-b6e9-2c5d5ac1941a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:39 devstack sudo[85883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64
Apr 08 11:04:39 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:39 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64" returned: 0 in 0.718s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:39 devstack sudo[85895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64
Apr 08 11:04:39 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:40 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7b556a5-f9df-4870-9682-b691e24f9d64" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-quobyte-a7b556a5-f9df-4870-9682-b691e24f9d64" released by "delete_volume" :: held 1.291s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Created reservations ['631ea037-c5f7-41ba-9866-61067631d4cc', '7280db29-855c-4d94-99a7-f9d35e234aa4', 'c98c5837-035c-42bf-840f-db9ee3f0113a', '80ae86dc-c11e-4ec5-b7ec-354440e9965a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:40 devstack sudo[85904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:40 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:40 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.551s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:40 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Deleted volume successfully.
Apr 08 11:04:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-64799f83-ee8c-41e4-a167-7ea4aa5e9f58 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-a7b556a5-f9df-4870-9682-b691e24f9d64-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Flow 'volume_create_manager' (2871331d-2299-4c03-b88f-1dadec510f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1574bda1-a11c-45c0-a111-967cbb020e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1574bda1-a11c-45c0-a111-967cbb020e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988490531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795a11a2-b512-4e12-9646-dd71c028573d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843af4857b8b471c9a6ad44e4f732762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:41Z,use_quota=True,user_id='81c218579fa844faa345b298677bdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e80089-5a43-4fad-b8eb-c7d2601c538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e80089-5a43-4fad-b8eb-c7d2601c538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e63125e-fc09-4c66-942a-3ca941049863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e63125e-fc09-4c66-942a-3ca941049863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795a11a2-b512-4e12-9646-dd71c028573d', 'volume_name': 'volume-795a11a2-b512-4e12-9646-dd71c028573d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549cacbd-7131-4373-8fc9-85b454fe15d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549cacbd-7131-4373-8fc9-85b454fe15d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca45d6-264c-4453-83e4-4bb97856b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Volume 795a11a2-b512-4e12-9646-dd71c028573d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795a11a2-b512-4e12-9646-dd71c028573d', 'volume_size': 1}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-988490531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795a11a2-b512-4e12-9646-dd71c028573d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='843af4857b8b471c9a6ad44e4f732762',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:41Z,use_quota=True,user_id='81c218579fa844faa345b298677bdd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Creating volume 795a11a2-b512-4e12-9646-dd71c028573d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:41 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:41 devstack sudo[85908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d 1073741824
Apr 08 11:04:41 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (df2e8c01-aae9-49af-ab72-6dcc19c65c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee6e0e2-b51e-4100-9d7f-8a7f370442bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee6e0e2-b51e-4100-9d7f-8a7f370442bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1297714636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:42Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74443270-6440-49a6-aba7-daa59ab0bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74443270-6440-49a6-aba7-daa59ab0bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb6f568-d9d8-4dcf-8d49-637eb68ad052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb6f568-d9d8-4dcf-8d49-637eb68ad052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8', 'volume_name': 'volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b6e84-8f14-49b3-bd9b-79bca4ae0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b6e84-8f14-49b3-bd9b-79bca4ae0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4ff403-0f44-42ff-b00e-17e15b76d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Volume 24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8', 'volume_size': 1}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:42 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d 1073741824" returned: 0 in 0.800s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:42 devstack sudo[85917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d
Apr 08 11:04:42 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:42 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d" returned: 0 in 0.533s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1297714636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:42Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Creating volume 24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:42 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:42 devstack sudo[85924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 1073741824
Apr 08 11:04:42 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca45d6-264c-4453-83e4-4bb97856b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795a11a2-b512-4e12-9646-dd71c028573d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb71ca-c0ca-457d-b326-5247858c93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Volume volume-795a11a2-b512-4e12-9646-dd71c028573d (795a11a2-b512-4e12-9646-dd71c028573d): created successfully
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fb71ca-c0ca-457d-b326-5247858c93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Flow 'volume_create_manager' (2871331d-2299-4c03-b88f-1dadec510f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a8ac6c17-dcae-4d8c-ad64-5afb9472f42f tempest-VolumesTransfersV357Test-685208393 None] Created volume successfully.
Apr 08 11:04:43 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 1073741824" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:43 devstack sudo[85931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8
Apr 08 11:04:43 devstack sudo[85931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "cinder-795a11a2-b512-4e12-9646-dd71c028573d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-795a11a2-b512-4e12-9646-dd71c028573d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "cinder-quobyte-795a11a2-b512-4e12-9646-dd71c028573d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-quobyte-795a11a2-b512-4e12-9646-dd71c028573d" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9774cc5-1ad7-447e-915c-227759fe0ce3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:44 devstack sudo[85933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d
Apr 08 11:04:44 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:44 devstack sudo[85931]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" returned: 0 in 0.547s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4ff403-0f44-42ff-b00e-17e15b76d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b8f74d-b197-42bd-bd32-34cb5e986a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:44 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Volume volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 (24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8): created successfully
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b8f74d-b197-42bd-bd32-34cb5e986a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (df2e8c01-aae9-49af-ab72-6dcc19c65c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:44 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ef86d75e-4270-4345-9d7d-482fcf06910d tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:04:44 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d" returned: 0 in 0.540s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:44 devstack sudo[85940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d
Apr 08 11:04:44 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:44 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-795a11a2-b512-4e12-9646-dd71c028573d" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-quobyte-795a11a2-b512-4e12-9646-dd71c028573d" released by "delete_volume" :: held 1.044s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:44 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Created reservations ['be140744-0880-447e-aaa9-01b2cf5c4801', '3506c547-a8ce-4a8e-844d-2844ce9b6b35', 'a0bade76-b753-4ce5-923e-0f6765ab3d89', '3c96cd82-48d9-47b5-b398-13fe65a43c12'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:45 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:45 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:45 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:45 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Deleted volume successfully.
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1021e3b8-170e-41f1-9893-27ad0e626a86 tempest-VolumesTransfersV357Test-1578358545 None] Lock "cinder-795a11a2-b512-4e12-9646-dd71c028573d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (3dc20ff8-1f79-477b-ac35-8be3e90a552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95b8568-5a64-41fc-8ad9-5276439511fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95b8568-5a64-41fc-8ad9-5276439511fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1384375588',display_name='tempest-VolumesGetTest-Volume-558985219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f48f70-1c80-4811-929f-d1515daa4f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:46Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b6a86-fa93-49ba-bd91-7a370a69b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380b6a86-fa93-49ba-bd91-7a370a69b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f122b39-8847-41bf-ac69-00dffa2cd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f122b39-8847-41bf-ac69-00dffa2cd205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f48f70-1c80-4811-929f-d1515daa4f7c', 'volume_name': 'volume-b9f48f70-1c80-4811-929f-d1515daa4f7c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2596c5-0a66-4a2d-9e43-ba0f9d75c1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2596c5-0a66-4a2d-9e43-ba0f9d75c1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8d9a52-6174-4db2-acbd-49534e256a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:45 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Volume b9f48f70-1c80-4811-929f-d1515daa4f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f48f70-1c80-4811-929f-d1515daa4f7c', 'volume_size': 1}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1384375588',display_name='tempest-VolumesGetTest-Volume-558985219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f48f70-1c80-4811-929f-d1515daa4f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:46Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Creating volume b9f48f70-1c80-4811-929f-d1515daa4f7c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:45 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:45 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c 1073741824
Apr 08 11:04:45 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:46 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c 1073741824" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:46 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c
Apr 08 11:04:46 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:46 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8d9a52-6174-4db2-acbd-49534e256a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f48f70-1c80-4811-929f-d1515daa4f7c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ae9e30-f9af-4a41-ae9c-9feb4dd3f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:46 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Volume volume-b9f48f70-1c80-4811-929f-d1515daa4f7c (b9f48f70-1c80-4811-929f-d1515daa4f7c): created successfully
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ae9e30-f9af-4a41-ae9c-9feb4dd3f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (3dc20ff8-1f79-477b-ac35-8be3e90a552c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:46 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4acd5271-8954-4d0a-8c65-74716a5badf4 tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:04:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-b9f48f70-1c80-4811-929f-d1515daa4f7c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "cinder-b9f48f70-1c80-4811-929f-d1515daa4f7c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-b9f48f70-1c80-4811-929f-d1515daa4f7c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-b9f48f70-1c80-4811-929f-d1515daa4f7c" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:48 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd618027-6465-4abf-8c94-c5bf685a5a82]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:48 devstack sudo[85958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c
Apr 08 11:04:48 devstack sudo[85958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:48 devstack sudo[85958]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c" returned: 0 in 0.693s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:48 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c
Apr 08 11:04:48 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:49 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b9f48f70-1c80-4811-929f-d1515daa4f7c" returned: 0 in 0.689s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-b9f48f70-1c80-4811-929f-d1515daa4f7c" released by "delete_volume" :: held 1.443s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Created reservations ['0db111a2-a658-4c17-9515-d1423de0d2f3', 'f63524ff-524d-47b1-acac-2a7067e6529f', '1ff78c83-4f55-4c1b-a5c4-5003db2be4ce', 'c8f20cef-b470-4808-97a8-f5e99d4880cf'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:49 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:49 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:50 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.567s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:50 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aebabf1-0add-49ba-9826-facfb4b0d31e tempest-VolumesGetTest-394513138 None] Lock "cinder-b9f48f70-1c80-4811-929f-d1515daa4f7c-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "cinder-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" acquired by "delete_volume" :: waited 0.019s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a2592-c1ba-48b3-8cad-f9889d6086d2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Flow 'volume_create_manager' (633c7f91-1885-4814-b442-ab7c056c085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0ae6a7-6ee5-40f2-bac0-6059b6a48025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:50 devstack sudo[86012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8
Apr 08 11:04:50 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0ae6a7-6ee5-40f2-bac0-6059b6a48025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1212882981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e075a3cf-5bc8-4d97-8dcd-d791e14e65f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0180c6142e8a40b5adc00099d7801ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:50Z,use_quota=True,user_id='596ac80c40c048b8907732d4b09437c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1740373e-b0ba-41f4-a75e-c8550841d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1740373e-b0ba-41f4-a75e-c8550841d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965bd289-fd40-4337-b412-a97ceffbd2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965bd289-fd40-4337-b412-a97ceffbd2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e075a3cf-5bc8-4d97-8dcd-d791e14e65f1', 'volume_name': 'volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1', 'volume_size': 2}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3096a4-9b6d-4711-9b3b-6ea389f57ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3096a4-9b6d-4711-9b3b-6ea389f57ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c60da4-f2eb-4cf4-b76c-90f128ff3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:50 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Volume e075a3cf-5bc8-4d97-8dcd-d791e14e65f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1', 'volume_size': 2}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1212882981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e075a3cf-5bc8-4d97-8dcd-d791e14e65f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0180c6142e8a40b5adc00099d7801ba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:50Z,use_quota=True,user_id='596ac80c40c048b8907732d4b09437c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Creating volume e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:50 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 2147483648 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:50 devstack sudo[86014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 2147483648
Apr 08 11:04:50 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:50 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" returned: 0 in 0.676s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:51 devstack sudo[86023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8
Apr 08 11:04:51 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:51 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 2147483648" returned: 0 in 0.622s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:51 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1
Apr 08 11:04:51 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:51 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8" released by "delete_volume" :: held 1.204s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Created reservations ['4f09b3ff-c952-48a6-8597-38c718975209', 'ef9e15db-c3fb-4fdf-950c-9e4aae6dec28', '69e1b551-c9fb-40ef-ba8c-4bbccaae00f9', '68867971-6513-441c-9561-98c6e76dfcc8'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:51 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:51 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:51 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" returned: 0 in 0.602s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c60da4-f2eb-4cf4-b76c-90f128ff3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1', 'volume_size': 2}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d1510b-4a52-4601-8329-91a07d50ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:51 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Volume volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 (e075a3cf-5bc8-4d97-8dcd-d791e14e65f1): created successfully
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d1510b-4a52-4601-8329-91a07d50ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Flow 'volume_create_manager' (633c7f91-1885-4814-b442-ab7c056c085e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:51 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b3c72a54-24b3-42d2-bdf0-6a8456c19b61 tempest-VolumesCloneNegativeTest-1019220865 None] Created volume successfully.
Apr 08 11:04:52 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2b897aba-df7c-4dc2-a285-45091a875cf3 tempest-VolumesGetTest-394513138 None] Lock "cinder-24f121a8-8ae3-4ffe-92b1-cfdeb46c5af8-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Acquiring lock "cinder-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "cinder-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Acquiring lock "cinder-quobyte-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "cinder-quobyte-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ac36d-9f55-4ff2-a84b-687ae2047000]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (330e4b87-6a12-482c-9af1-1a520606f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1767e377-0d6a-44ec-9d55-c54222a3f791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1767e377-0d6a-44ec-9d55-c54222a3f791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1105674077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb1bbd3-597b-4903-940b-8b68bf127123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:53Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb6ce61-d600-4df4-8d7c-80223c3d88ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb6ce61-d600-4df4-8d7c-80223c3d88ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa788810-ee97-4f4c-94b9-9db488db1cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa788810-ee97-4f4c-94b9-9db488db1cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb1bbd3-597b-4903-940b-8b68bf127123', 'volume_name': 'volume-1fb1bbd3-597b-4903-940b-8b68bf127123', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7624e9-e791-4b2f-9594-8199e26d7cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:52 devstack sudo[86036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1
Apr 08 11:04:52 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7624e9-e791-4b2f-9594-8199e26d7cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9212dbad-8817-4bf3-bef6-10b9550540d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Volume 1fb1bbd3-597b-4903-940b-8b68bf127123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb1bbd3-597b-4903-940b-8b68bf127123', 'volume_size': 1}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1105674077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb1bbd3-597b-4903-940b-8b68bf127123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:53Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Creating volume 1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:04:52 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:04:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:52 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 1073741824
Apr 08 11:04:52 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:53 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" returned: 0 in 0.606s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:53 devstack sudo[86046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1
Apr 08 11:04:53 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:53 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 1073741824" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:53 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:04:53 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:54 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.761s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9212dbad-8817-4bf3-bef6-10b9550540d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb1bbd3-597b-4903-940b-8b68bf127123', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9919cdb2-c067-463b-983b-8e2c749c2804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:54 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Volume volume-1fb1bbd3-597b-4903-940b-8b68bf127123 (1fb1bbd3-597b-4903-940b-8b68bf127123): created successfully
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9919cdb2-c067-463b-983b-8e2c749c2804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (330e4b87-6a12-482c-9af1-1a520606f168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-67548f88-2bd0-40ee-9496-5ccd81c815b6 tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:04:54 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" returned: 0 in 0.921s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "cinder-quobyte-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1" released by "delete_volume" :: held 1.596s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Created reservations ['f4a61102-f39a-4df8-ac6d-54ef367683bb', '4eb830cd-61b1-48d2-b2bd-7da89195b80d', '68521684-aa0e-4edc-86a7-06acc3d1c047', '0ed6c55c-2199-42d9-a978-9bf997f268ba'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:54 devstack sudo[86085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:04:54 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:55 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.769s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:04:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Deleted volume successfully.
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b04c411b-240d-4d2d-bb28-ce33601ffceb tempest-VolumesCloneNegativeTest-1019220865 None] Lock "cinder-e075a3cf-5bc8-4d97-8dcd-d791e14e65f1-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (ff7f741a-5200-41ab-8481-7734275f1102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5b41d4-1ee8-4165-a62d-44f043001097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5b41d4-1ee8-4165-a62d-44f043001097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1764517584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259839dc-1eb2-433b-b125-9bd85eb9e2db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=1fb1bbd3-597b-4903-940b-8b68bf127123,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:56Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb637a2a-e1d6-47f2-b123-5543cc2478b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb637a2a-e1d6-47f2-b123-5543cc2478b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49f583d-ccbc-4e13-90da-bd240db344f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49f583d-ccbc-4e13-90da-bd240db344f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '259839dc-1eb2-433b-b125-9bd85eb9e2db', 'volume_name': 'volume-259839dc-1eb2-433b-b125-9bd85eb9e2db', 'volume_size': 1, 'source_volid': '1fb1bbd3-597b-4903-940b-8b68bf127123', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149374f4-3091-4341-aa1d-9040bfa088c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149374f4-3091-4341-aa1d-9040bfa088c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e5472d-3a5d-42b9-b3a8-2ac5bad0fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:55 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Volume 259839dc-1eb2-433b-b125-9bd85eb9e2db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-259839dc-1eb2-433b-b125-9bd85eb9e2db', 'volume_size': 1, 'source_volid': '1fb1bbd3-597b-4903-940b-8b68bf127123', 'source_volstatus': 'available'}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:55 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Cloning volume 1fb1bbd3-597b-4903-940b-8b68bf127123 to volume 259839dc-1eb2-433b-b125-9bd85eb9e2db
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Creating offline snapshot 6ffeea70-7509-46c8-9e1a-a41ed5d45857 of volume 1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[32212c1b-1da8-493f-8bb9-e9eb992be543]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:55 devstack sudo[86090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:04:55 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:56 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.965s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:56 devstack sudo[86096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 1G
Apr 08 11:04:56 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (92b03891-582e-4268-87d9-17f4340e6077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1957a09b-ef1e-4f68-92e1-0c3d2a914f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1957a09b-ef1e-4f68-92e1-0c3d2a914f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-25709519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbf7e4c-5203-4750-ac85-c45928eb5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:57Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50854d5b-1152-4f26-82ec-a7eb7670142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50854d5b-1152-4f26-82ec-a7eb7670142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17120d44-dcd7-43f9-8314-a3209810dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17120d44-dcd7-43f9-8314-a3209810dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbf7e4c-5203-4750-ac85-c45928eb5275', 'volume_name': 'volume-6dbf7e4c-5203-4750-ac85-c45928eb5275', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb3caf-8fb4-4a8b-a304-69660b061e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45eb3caf-8fb4-4a8b-a304-69660b061e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f155c1-28e1-42dd-a236-07a05f176246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Volume 6dbf7e4c-5203-4750-ac85-c45928eb5275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbf7e4c-5203-4750-ac85-c45928eb5275', 'volume_size': 1}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:57 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 1G" returned: 0 in 0.884s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb1bbd3-597b-4903-940b-8b68bf127123 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:57 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb1bbd3-597b-4903-940b-8b68bf127123 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:04:57 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Flow 'volume_create_manager' (7acd1c08-5dd5-4b51-a807-b9bb0531fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dff417-d81b-487a-8018-57fcc00493fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1dff417-d81b-487a-8018-57fcc00493fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1957912052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c1132b-8915-4059-bbdf-1d5804414b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daa35b78e044de59c0f066e76f037e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:58Z,use_quota=True,user_id='f49a2eacc0594f059192e39d2098ad8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f10064-b2c6-4026-ac6c-770e527f78c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f10064-b2c6-4026-ac6c-770e527f78c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c580957-699a-4a2c-9722-a5959a103833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c580957-699a-4a2c-9722-a5959a103833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c1132b-8915-4059-bbdf-1d5804414b3c', 'volume_name': 'volume-10c1132b-8915-4059-bbdf-1d5804414b3c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f480506-d774-4574-ba65-a23c0d1e6746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f480506-d774-4574-ba65-a23c0d1e6746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bf324c-a627-49ee-9a51-807b5e2fd6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:04:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Volume 10c1132b-8915-4059-bbdf-1d5804414b3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c1132b-8915-4059-bbdf-1d5804414b3c', 'volume_size': 1}
Apr 08 11:04:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:58 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fb1bbd3-597b-4903-940b-8b68bf127123 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:58 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 is being set with open permissions: ugo+rw
Apr 08 11:04:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:58 devstack sudo[86106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:04:58 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:58 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.497s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:58 devstack sudo[86110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info
Apr 08 11:04:58 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:59 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info" returned: 0 in 0.671s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:59 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info is being set with open permissions: ugo+rw
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:04:59 devstack sudo[86113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info
Apr 08 11:04:59 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:04:59 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.info" returned: 0 in 0.552s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] snapshot: 6ffeea70-7509-46c8-9e1a-a41ed5d45857, volume: 259839dc-1eb2-433b-b125-9bd85eb9e2db,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e21d3-8785-4e75-9a62-ed2a0ac6daf5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:04:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:00 devstack sudo[86117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:05:00 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Flow 'volume_create_manager' (ef96ead4-4bd3-476d-8c61-97740e001a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef0bee-70f2-491b-9524-7ca097214636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ef0bee-70f2-491b-9524-7ca097214636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abb5220-1aac-427b-8ee5-2ad5a1a8bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9f0253529845c685afa6cf02f849bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:01Z,use_quota=True,user_id='796f61acef604ddabf2f75d5a62d7867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2472a972-74a5-4e81-8ab1-b4dd0cc3bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2472a972-74a5-4e81-8ab1-b4dd0cc3bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027601-92cc-4b26-8450-776e6657ac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.image.glance [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Creating Keystone auth plugin from conf {{(pid=82670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 08 11:05:00 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.755s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fb1bbd3-597b-4903-940b-8b68bf127123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cf88d8-69e4-4da9-a226-3f4d1113e80e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:00 devstack sudo[86124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:05:00 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027601-92cc-4b26-8450-776e6657ac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1abb5220-1aac-427b-8ee5-2ad5a1a8bebf', 'volume_name': 'volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea252d360>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51305f7-79a8-4e0a-8659-38f4b7d75403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51305f7-79a8-4e0a-8659-38f4b7d75403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357bcc10-ed57-4b6d-95ee-df1b89583fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea252d360>}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Trying to clone 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf from image e79cd67c-0f76-457d-af5e-4472f723e6f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]). {{(pid=82670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 08 11:05:01 devstack cinder-volume[82670]: INFO cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Image download 20.69 MB at 20.69 MB/s
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b72e4c0-65e7-47ad-a38b-c57ebe795612]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:01 devstack sudo[86149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD
Apr 08 11:05:01 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:01 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.842s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:01 devstack sudo[86153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db
Apr 08 11:05:01 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:01 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:01 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 is fetched for user 796f61acef604ddabf2f75d5a62d7867. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b25573e-56df-42f2-a075-e58d431299d0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:02 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD
Apr 08 11:05:02 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:02 devstack sudo[86173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:02 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:04 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD" returned: 0 in 2.014s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:04 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 2.252s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:04 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:05 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db" returned: 0 in 3.852s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:05 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9d7b7a-499a-4197-8c2e-572972f1363e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:05 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:05:05 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:06 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123, size 1024.00 MB, duration 3.85 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:05:06 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Converted 1024.00 MB image at 265.73 MB/s
Apr 08 11:05:06 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db is being set with open permissions: ugo+rw
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:06 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db
Apr 08 11:05:06 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:06 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db" returned: 0 in 0.475s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" released by "_copy_volume_from_snapshot" :: held 6.587s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-6ffeea70-7509-46c8-9e1a-a41ed5d45857" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-6ffeea70-7509-46c8-9e1a-a41ed5d45857" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Deleting offline snapshot 6ffeea70-7509-46c8-9e1a-a41ed5d45857 of volume 1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] snapshot_file for this snap is: volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aafe1b-5209-4d01-9eca-2da17b4c3e31]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:06 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:05:06 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:07 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fb1bbd3-597b-4903-940b-8b68bf127123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7491e9bb-8ef7-4fb2-8e79-62b40d7630b0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:07 devstack sudo[86208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:05:07 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:07 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.489s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:07 devstack sudo[86214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:05:07 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:08 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:08 devstack sudo[86219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857
Apr 08 11:05:08 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:08 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123.6ffeea70-7509-46c8-9e1a-a41ed5d45857" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-6ffeea70-7509-46c8-9e1a-a41ed5d45857" released by "_delete_snapshot" :: held 1.903s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.743s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.180s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-25709519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbf7e4c-5203-4750-ac85-c45928eb5275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:57Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Creating volume 6dbf7e4c-5203-4750-ac85-c45928eb5275 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:08 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e5472d-3a5d-42b9-b3a8-2ac5bad0fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259839dc-1eb2-433b-b125-9bd85eb9e2db', 'volume_size': 1, 'source_volid': '1fb1bbd3-597b-4903-940b-8b68bf127123', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8357d4-ef43-4d83-8c81-bff010511c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:08 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 1073741824
Apr 08 11:05:08 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:08 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Volume volume-259839dc-1eb2-433b-b125-9bd85eb9e2db (259839dc-1eb2-433b-b125-9bd85eb9e2db): created successfully
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8357d4-ef43-4d83-8c81-bff010511c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (ff7f741a-5200-41ab-8481-7734275f1102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d62b5e3c-58b2-498a-8c8d-3f15653c6407 tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:05:09 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 1073741824" returned: 0 in 0.642s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:09 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275
Apr 08 11:05:09 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (2800000b-8557-4074-966a-3de34044b1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7033d7ea-a0b4-4cd9-8dd5-285fa9a35877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7033d7ea-a0b4-4cd9-8dd5-285fa9a35877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2019328493',display_name='tempest-VolumesGetTest-Volume-1906523983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ead3a5-c8db-4415-a15b-f5c7fa8bf252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:09Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472b1f98-ebea-4313-bc81-fa76240d73eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472b1f98-ebea-4313-bc81-fa76240d73eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684e50df-8ef6-4100-87a8-b6b501234035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684e50df-8ef6-4100-87a8-b6b501234035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ead3a5-c8db-4415-a15b-f5c7fa8bf252', 'volume_name': 'volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7577fb84-1fbb-4d7c-9439-73c217865b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7577fb84-1fbb-4d7c-9439-73c217865b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7340defe-ec30-4a31-847a-32e496f2df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Volume 87ead3a5-c8db-4415-a15b-f5c7fa8bf252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252', 'volume_size': 1}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:09 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275" returned: 0 in 0.436s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.808s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1957912052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c1132b-8915-4059-bbdf-1d5804414b3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1daa35b78e044de59c0f066e76f037e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:04:58Z,use_quota=True,user_id='f49a2eacc0594f059192e39d2098ad8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Creating volume 10c1132b-8915-4059-bbdf-1d5804414b3c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:09 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f155c1-28e1-42dd-a236-07a05f176246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbf7e4c-5203-4750-ac85-c45928eb5275', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack sudo[86230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c 1073741824
Apr 08 11:05:09 devstack sudo[86230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2526aacd-8993-477a-b239-eaf4a875ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:09 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Volume volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 (6dbf7e4c-5203-4750-ac85-c45928eb5275): created successfully
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2526aacd-8993-477a-b239-eaf4a875ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (92b03891-582e-4268-87d9-17f4340e6077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-240d3c00-9155-49e4-a932-597c770859d2 tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:10 devstack sudo[86230]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c 1073741824" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:10 devstack sudo[86235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c
Apr 08 11:05:10 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2e07f854-c6f5-464a-ab93-468f36333dbb tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275" by "attach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2e07f854-c6f5-464a-ab93-468f36333dbb tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275" acquired by "attach_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:10 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.453s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:00Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abb5220-1aac-427b-8ee5-2ad5a1a8bebf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9f0253529845c685afa6cf02f849bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:01Z,use_quota=True,user_id='796f61acef604ddabf2f75d5a62d7867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Creating volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:10 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bf324c-a627-49ee-9a51-807b5e2fd6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c1132b-8915-4059-bbdf-1d5804414b3c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0484ab-27ed-4415-800d-0233931eeead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:10 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1073741824
Apr 08 11:05:10 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:10 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Volume volume-10c1132b-8915-4059-bbdf-1d5804414b3c (10c1132b-8915-4059-bbdf-1d5804414b3c): created successfully
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0484ab-27ed-4415-800d-0233931eeead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Flow 'volume_create_manager' (7acd1c08-5dd5-4b51-a807-b9bb0531fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2c92a18a-0741-4adc-ade0-a6ba3cc39dd8 tempest-VolumesNegativeTest-1738632939 None] Created volume successfully.
Apr 08 11:05:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2e07f854-c6f5-464a-ab93-468f36333dbb tempest-VolumesActionsTest-1227534448 None] Attaching volume 6dbf7e4c-5203-4750-ac85-c45928eb5275 to instance 9667b79e-c64e-4437-9389-0b248ce8dc13 at mountpoint /dev/vdb on host None.
Apr 08 11:05:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2e07f854-c6f5-464a-ab93-468f36333dbb tempest-VolumesActionsTest-1227534448 None] Attach volume completed successfully.
Apr 08 11:05:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2e07f854-c6f5-464a-ab93-468f36333dbb tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275" released by "attach_volume" :: held 0.136s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:11 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1073741824" returned: 0 in 0.562s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:11 devstack sudo[86243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:11 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:11 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Terminate volume connection completed successfully.
Apr 08 11:05:11 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 0.734s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2019328493',display_name='tempest-VolumesGetTest-Volume-1906523983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ead3a5-c8db-4415-a15b-f5c7fa8bf252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:09Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Creating volume 87ead3a5-c8db-4415-a15b-f5c7fa8bf252 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:11 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:11 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Attempting download of e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 08 11:05:12 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 1073741824
Apr 08 11:05:12 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[78137818-3de4-4169-b4f5-3566ebd66257]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:12 devstack sudo[86255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr
Apr 08 11:05:12 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" by "detach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Detaching volume 6dbf7e4c-5203-4750-ac85-c45928eb5275 from instance 9667b79e-c64e-4437-9389-0b248ce8dc13.
Apr 08 11:05:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Detach volume completed successfully.
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4149e9b9-7b57-4ead-8f54-fa402f13e51d tempest-VolumesActionsTest-1513342221 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:12 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:12 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr
Apr 08 11:05:12 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5ec4863f-cd21-4fea-a3d5-4024dc844d9f tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" by "detach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:12 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5ec4863f-cd21-4fea-a3d5-4024dc844d9f tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5ec4863f-cd21-4fea-a3d5-4024dc844d9f tempest-VolumesActionsTest-1227534448 None] Volume detach called, but volume not attached.
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 1073741824" returned: 0 in 1.009s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5ec4863f-cd21-4fea-a3d5-4024dc844d9f tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:12 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252
Apr 08 11:05:12 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:13 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr" returned: 1 in 0.662s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_1sr4nvpr' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[55635e84-52eb-4bc0-b507-0508094f8762]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:13 devstack sudo[86270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD
Apr 08 11:05:13 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:13 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" returned: 0 in 0.459s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7340defe-ec30-4a31-847a-32e496f2df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff4a51-c75b-4821-bed2-21ae13cf0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:13 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Volume volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 (87ead3a5-c8db-4415-a15b-f5c7fa8bf252): created successfully
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ff4a51-c75b-4821-bed2-21ae13cf0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (2800000b-8557-4074-966a-3de34044b1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:13 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-43b4449f-30eb-4ac9-b9a6-7fe5e18a332d tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-quobyte-6dbf7e4c-5203-4750-ac85-c45928eb5275" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-quobyte-6dbf7e4c-5203-4750-ac85-c45928eb5275" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd953c-fafa-4a65-9c3e-9d21456e1c6f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-87ead3a5-c8db-4415-a15b-f5c7fa8bf252-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "cinder-87ead3a5-c8db-4415-a15b-f5c7fa8bf252-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:13 devstack sudo[86274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275
Apr 08 11:05:13 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e5dbb-32f0-4300-baf2-3835b7df84a9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:14 devstack sudo[86276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252
Apr 08 11:05:14 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:14 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD" returned: 0 in 0.918s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] e79cd67c-0f76-457d-af5e-4472f723e6f9 was qcow2, converting to raw {{(pid=82670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:14 devstack sudo[86281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:14 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:14 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275" returned: 0 in 0.826s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:14 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275
Apr 08 11:05:14 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:14 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" returned: 0 in 1.013s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:14 devstack sudo[86291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252
Apr 08 11:05:14 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:15 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6dbf7e4c-5203-4750-ac85-c45928eb5275" returned: 0 in 0.716s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-quobyte-6dbf7e4c-5203-4750-ac85-c45928eb5275" released by "delete_volume" :: held 1.563s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Created reservations ['3e740a8c-311f-4d89-b092-8e27a666f570', 'eecda7b7-511c-44ee-8de9-28d042305ce8', '09146998-9afa-443c-8321-7bde50882b44', 'ed48dafe-3307-4242-a4e4-0a340bd5d44b'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:15 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:15 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:15 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" returned: 0 in 0.640s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-87ead3a5-c8db-4415-a15b-f5c7fa8bf252" released by "delete_volume" :: held 1.683s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Created reservations ['d3985ea1-0af6-46f3-ac76-289cd0a0b2f3', '27152668-0835-4646-8dc0-7dcd917069d5', 'aaea7437-5b22-4776-8a49-3b9cf4e002ff', '1990c99b-2665-455c-b21a-222bdb4ba08d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:15 devstack sudo[86319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:15 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:16 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 1.991s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_xigb916_devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:05:16 devstack cinder-volume[82670]: INFO cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Converted 112.00 MB image at 56.20 MB/s
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:16 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1G
Apr 08 11:05:16 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:16 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-259839dc-1eb2-433b-b125-9bd85eb9e2db-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "cinder-259839dc-1eb2-433b-b125-9bd85eb9e2db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a9d32d75-4697-4bbc-97cf-536277690be6 tempest-VolumesGetTest-394513138 None] Lock "cinder-87ead3a5-c8db-4415-a15b-f5c7fa8bf252-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:16 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.864s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Deleted volume successfully.
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f31d01-3053-4334-b0d2-d51241a33f9f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d07cc599-fabc-4733-9ee2-ef24f0a163a0 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-6dbf7e4c-5203-4750-ac85-c45928eb5275-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:16 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db
Apr 08 11:05:16 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:17 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf 1G" returned: 0 in 0.915s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:17 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db" returned: 0 in 0.678s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9505cf46-a814-4eb5-a812-a06f0b738325]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:17 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db
Apr 08 11:05:17 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:17 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:17 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:17 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-259839dc-1eb2-433b-b125-9bd85eb9e2db" returned: 0 in 0.716s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-259839dc-1eb2-433b-b125-9bd85eb9e2db" released by "delete_volume" :: held 1.447s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:17 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 0.714s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Created reservations ['637e30f5-55b8-478d-82ce-d004d60273b1', '253b0a64-1393-415b-83fd-ec79fa711bcd', '9584876a-fb6f-46a5-bb33-45c8540bb13f', '25b354fa-dc7d-47f6-ae30-4b503610ea02'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:17 devstack sudo[86367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:17 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:17 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:17 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:18 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 1 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Downloaded image e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf successfully. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 for user 796f61acef604ddabf2f75d5a62d7867 is deleted. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Marking volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf as bootable. {{(pid=82670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Copying metadata from image e79cd67c-0f76-457d-af5e-4472f723e6f9 to 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf. {{(pid=82670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Creating volume glance metadata for volume 1abb5220-1aac-427b-8ee5-2ad5a1a8bebf backed by image e79cd67c-0f76-457d-af5e-4472f723e6f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 08 11:05:18 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.532s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357bcc10-ed57-4b6d-95ee-df1b89583fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea252d360>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd88172-347f-4fdf-ab87-f0370caaf851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Volume volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf (1abb5220-1aac-427b-8ee5-2ad5a1a8bebf): created successfully
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd88172-347f-4fdf-ab87-f0370caaf851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Flow 'volume_create_manager' (ef96ead4-4bd3-476d-8c61-97740e001a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f60083c9-36eb-4099-83f3-a3ca8535a372 tempest-VolumesGetTest-394513138 None] Lock "cinder-259839dc-1eb2-433b-b125-9bd85eb9e2db-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-5e32ad59-3203-472a-ae3c-5dd6bb7c5250 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Created volume successfully.
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-1fb1bbd3-597b-4903-940b-8b68bf127123-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "cinder-1fb1bbd3-597b-4903-940b-8b68bf127123-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-1fb1bbd3-597b-4903-940b-8b68bf127123" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-1fb1bbd3-597b-4903-940b-8b68bf127123" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[79110142-ae67-4331-bb0c-01cdea897abd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:18 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:05:18 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:19 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.577s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:19 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123
Apr 08 11:05:19 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b067b0c-ebe0-43a6-9b08-9ed88ba2dab3]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:19 devstack sudo[86410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:19 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:19 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1fb1bbd3-597b-4903-940b-8b68bf127123" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-1fb1bbd3-597b-4903-940b-8b68bf127123" released by "delete_volume" :: held 1.067s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Created reservations ['1f2324e3-ccf6-4e53-85d8-a5e7d3e4fbff', 'e2377aeb-ad54-428b-8466-16667e569b22', '3d5748be-dab6-430f-be92-6bef2fcd2cef', '990575a3-232b-46d8-819d-703b560b1400'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:19 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:19 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:19 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:19 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:19 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:20 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-97732949-3561-46c1-94d5-3fd2becb036c tempest-VolumesGetTest-394513138 None] Lock "cinder-1fb1bbd3-597b-4903-940b-8b68bf127123-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:20 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 1 in 0.534s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd', 'name': 'volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2db78b5-1b87-4c68-bdb3-521681a7c194', 'enforce_multipath': True} {{(pid=82670) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 08 11:05:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-460f3687-db57-4c0c-8bd4-1ab334c324df req-9702e99d-83e0-43ab-bbc6-bebcf7de7870 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] attachment_update completed successfully.
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (e9deafcd-e60d-47f3-91a1-8bc47d2e0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb27771b-3d9a-40a8-9be5-d9d289608b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb27771b-3d9a-40a8-9be5-d9d289608b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752825401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb057a71-973a-424d-956c-6ba94f2c527e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:21Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31242e-7c3c-44f7-9bdb-41e95f23ff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31242e-7c3c-44f7-9bdb-41e95f23ff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93eb5c8e-9f48-4697-b141-7c49ecf45e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.image.glance [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Creating Keystone auth plugin from conf {{(pid=82670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93eb5c8e-9f48-4697-b141-7c49ecf45e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb057a71-973a-424d-956c-6ba94f2c527e', 'volume_name': 'volume-fb057a71-973a-424d-956c-6ba94f2c527e', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2421fc0>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0784bf0c-7281-41d0-95d3-ed2242713ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0784bf0c-7281-41d0-95d3-ed2242713ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff4866e-9783-40e6-940a-3441a6598f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Volume fb057a71-973a-424d-956c-6ba94f2c527e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb057a71-973a-424d-956c-6ba94f2c527e', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2421fc0>}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Trying to clone fb057a71-973a-424d-956c-6ba94f2c527e from image e79cd67c-0f76-457d-af5e-4472f723e6f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]). {{(pid=82670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 08 11:05:21 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Image download 20.69 MB at 20.69 MB/s
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0350e1-cbd0-48cf-83df-ae80afa56f77]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:21 devstack sudo[86429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD
Apr 08 11:05:21 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:22 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 is fetched for user 7b973dd8b3694882a177bae093a23901. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffa355d-b1e2-437b-aaf7-3ca44f7b1f7f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:22 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD
Apr 08 11:05:22 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (e87ec44d-d855-4367-a87a-3c378b7873a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c38347d-07ca-4c08-9cd1-5c1771fbc7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c38347d-07ca-4c08-9cd1-5c1771fbc7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-711442627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a419d4f-3fbb-4973-9fe2-33167f1319d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:23Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2082eeaf-cf20-4c02-ba86-1da85148b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2082eeaf-cf20-4c02-ba86-1da85148b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25db9da5-465b-4c37-bd7d-56a9a9e21dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25db9da5-465b-4c37-bd7d-56a9a9e21dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a419d4f-3fbb-4973-9fe2-33167f1319d6', 'volume_name': 'volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5521f50d-1bef-48d4-a0a0-7af6c841326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5521f50d-1bef-48d4-a0a0-7af6c841326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a938f4-9575-49a9-bcc9-87579a6811c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:22 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Volume 6a419d4f-3fbb-4973-9fe2-33167f1319d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6', 'volume_size': 1}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-711442627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a419d4f-3fbb-4973-9fe2-33167f1319d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:23Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Creating volume 6a419d4f-3fbb-4973-9fe2-33167f1319d6 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:22 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:22 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 1073741824
Apr 08 11:05:22 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:22 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:23 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 1073741824" returned: 0 in 1.033s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:23 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6
Apr 08 11:05:23 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:24 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752825401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb057a71-973a-424d-956c-6ba94f2c527e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:21Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Creating volume fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:24 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a938f4-9575-49a9-bcc9-87579a6811c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8224ade-5a92-4183-a8fc-12d212fb23de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:24 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1073741824
Apr 08 11:05:24 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:24 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Volume volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 (6a419d4f-3fbb-4973-9fe2-33167f1319d6): created successfully
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8224ade-5a92-4183-a8fc-12d212fb23de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (e87ec44d-d855-4367-a87a-3c378b7873a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-96496c05-3a58-44b8-9f23-d0270ba8eee3 tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:24 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1073741824" returned: 0 in 0.626s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:24 devstack sudo[86483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:24 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-6a419d4f-3fbb-4973-9fe2-33167f1319d6-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-6a419d4f-3fbb-4973-9fe2-33167f1319d6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-quobyte-6a419d4f-3fbb-4973-9fe2-33167f1319d6" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-6a419d4f-3fbb-4973-9fe2-33167f1319d6" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d279f5-a1f3-494e-8f24-97d8b9101163]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:25 devstack sudo[86485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6
Apr 08 11:05:25 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:25 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 0 in 0.781s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Attempting download of e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume fb057a71-973a-424d-956c-6ba94f2c527e. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 08 11:05:25 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6" returned: 0 in 0.756s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:25 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6
Apr 08 11:05:25 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[81643c68-e885-40fc-b111-dbf125638851]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:25 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6
Apr 08 11:05:25 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:26 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a419d4f-3fbb-4973-9fe2-33167f1319d6" returned: 0 in 0.568s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-6a419d4f-3fbb-4973-9fe2-33167f1319d6" released by "delete_volume" :: held 1.365s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Created reservations ['e3c98a0f-1a3f-4a06-af5f-a9844f8d8799', 'd9250aa8-e53b-4ab2-973b-7d1b6440012c', 'ad5a41d1-a119-4bfa-8a6e-63c2d6779dc8', 'd0ed6b3d-32f8-4e87-8d4c-c0d9da13a086'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:26 devstack sudo[86524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:26 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:26 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6" returned: 0 in 0.731s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:26 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6
Apr 08 11:05:26 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:26 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:26 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Deleted volume successfully.
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9f7e9acf-adba-4c76-aa31-3ba9d966d4f3 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-6a419d4f-3fbb-4973-9fe2-33167f1319d6-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:26 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6" returned: 1 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_qhit1hc6' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4033b65c-110a-4921-bffa-2e93b6e25a91]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:27 devstack sudo[86532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD
Apr 08 11:05:27 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (8c34209e-48cc-4b91-b429-41ad7225fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373c0eee-805a-4acd-8c91-5805e2703584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373c0eee-805a-4acd-8c91-5805e2703584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671637256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa5e46-503e-4114-94f4-570d7c242522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:27Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf11b19c-54ec-43f2-b4c1-15fca98cbad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf11b19c-54ec-43f2-b4c1-15fca98cbad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597de653-2681-4b2d-a4ab-f4234d2c8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597de653-2681-4b2d-a4ab-f4234d2c8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaa5e46-503e-4114-94f4-570d7c242522', 'volume_name': 'volume-8aaa5e46-503e-4114-94f4-570d7c242522', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2aeb81-36d8-44b0-9da5-b9c2e7a29d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2aeb81-36d8-44b0-9da5-b9c2e7a29d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff52754-2aaa-47d2-8acf-9960793dcd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:27 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Volume 8aaa5e46-503e-4114-94f4-570d7c242522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaa5e46-503e-4114-94f4-570d7c242522', 'volume_size': 1}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1671637256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaa5e46-503e-4114-94f4-570d7c242522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:27Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Creating volume 8aaa5e46-503e-4114-94f4-570d7c242522 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:27 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:27 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] e79cd67c-0f76-457d-af5e-4472f723e6f9 was qcow2, converting to raw {{(pid=82670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 08 11:05:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:27 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 1073741824
Apr 08 11:05:27 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:27 devstack sudo[86559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:27 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:28 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 1073741824" returned: 0 in 0.600s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:28 devstack sudo[86571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522
Apr 08 11:05:28 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:28 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 0 in 1.220s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_ltwvro7kdevstack@QuobyteHD, size 112.00 MB, duration 1.22 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:05:28 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Converted 112.00 MB image at 91.69 MB/s
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:28 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522" returned: 0 in 0.664s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:28 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1G
Apr 08 11:05:28 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff52754-2aaa-47d2-8acf-9960793dcd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaa5e46-503e-4114-94f4-570d7c242522', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4ac520-f40b-41ce-bf7c-dcac16b36700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:28 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Volume volume-8aaa5e46-503e-4114-94f4-570d7c242522 (8aaa5e46-503e-4114-94f4-570d7c242522): created successfully
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4ac520-f40b-41ce-bf7c-dcac16b36700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:28 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (8c34209e-48cc-4b91-b429-41ad7225fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ee200f0e-29e7-4184-873e-c1d101a40e4b tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:29 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e 1G" returned: 0 in 0.597s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[271279e3-ff65-4ce9-a212-8337141c5710]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:29 devstack sudo[86586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:29 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-8aaa5e46-503e-4114-94f4-570d7c242522-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-8aaa5e46-503e-4114-94f4-570d7c242522-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-quobyte-8aaa5e46-503e-4114-94f4-570d7c242522" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-8aaa5e46-503e-4114-94f4-570d7c242522" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf19adff-dbb3-48d7-a170-6883b5b00b16]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:29 devstack sudo[86595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522
Apr 08 11:05:29 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:29 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 0 in 0.604s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:30 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:30 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:30 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522" returned: 0 in 0.572s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:30 devstack sudo[86604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522
Apr 08 11:05:30 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:30 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 1 in 0.609s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Downloaded image e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume fb057a71-973a-424d-956c-6ba94f2c527e successfully. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 for user 7b973dd8b3694882a177bae093a23901 is deleted. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Marking volume fb057a71-973a-424d-956c-6ba94f2c527e as bootable. {{(pid=82670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Copying metadata from image e79cd67c-0f76-457d-af5e-4472f723e6f9 to fb057a71-973a-424d-956c-6ba94f2c527e. {{(pid=82670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Creating volume glance metadata for volume fb057a71-973a-424d-956c-6ba94f2c527e backed by image e79cd67c-0f76-457d-af5e-4472f723e6f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ff4866e-9783-40e6-940a-3441a6598f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb057a71-973a-424d-956c-6ba94f2c527e', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2421fc0>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa360ba-de2d-4a11-b33e-3c91085e6a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:30 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Volume volume-fb057a71-973a-424d-956c-6ba94f2c527e (fb057a71-973a-424d-956c-6ba94f2c527e): created successfully
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa360ba-de2d-4a11-b33e-3c91085e6a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (e9deafcd-e60d-47f3-91a1-8bc47d2e0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4add70e6-5a2c-4468-8dc4-021dfcb7b348 tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:05:30 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8aaa5e46-503e-4114-94f4-570d7c242522" returned: 0 in 0.543s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-8aaa5e46-503e-4114-94f4-570d7c242522" released by "delete_volume" :: held 1.163s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Created reservations ['262d5124-7d11-4dd1-baee-b4dd19d4e98c', 'd4c5c082-a1b7-4c5e-909d-142d1a0fe6a2', 'fbe594a9-16e4-40c5-a4a4-b98a38301142', 'f83f8ab8-ef10-485d-8732-6feee383c6d3'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:31 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:31 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (3dba609c-9476-45d9-8788-bf5c09ad40a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003ba4f0-8345-4434-9a20-159997282650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003ba4f0-8345-4434-9a20-159997282650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1711195485',display_name='tempest-VolumesGetTest-Volume-1910966566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a68bcc-5a69-447e-8c10-478aefc52095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:31Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2a841-e24b-4d8f-87fa-a666ad3630a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2a841-e24b-4d8f-87fa-a666ad3630a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4057c1a3-04b4-4740-a7fd-95e492171a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4057c1a3-04b4-4740-a7fd-95e492171a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a68bcc-5a69-447e-8c10-478aefc52095', 'volume_name': 'volume-d6a68bcc-5a69-447e-8c10-478aefc52095', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b308e89-7d27-4c6f-a263-e9d068b7cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b308e89-7d27-4c6f-a263-e9d068b7cf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f4572-668a-4047-ac12-599def28e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:31 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Volume d6a68bcc-5a69-447e-8c10-478aefc52095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a68bcc-5a69-447e-8c10-478aefc52095', 'volume_size': 1}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1711195485',display_name='tempest-VolumesGetTest-Volume-1910966566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a68bcc-5a69-447e-8c10-478aefc52095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff2495e164d48fda2f21eabe2c24bcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:31Z,use_quota=True,user_id='7b973dd8b3694882a177bae093a23901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Creating volume d6a68bcc-5a69-447e-8c10-478aefc52095 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:31 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:31 devstack sudo[86613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 1073741824
Apr 08 11:05:31 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:31 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Deleted volume successfully.
Apr 08 11:05:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb270e0e-eba4-4a67-bdba-103988c51511 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-8aaa5e46-503e-4114-94f4-570d7c242522-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:32 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 1073741824" returned: 0 in 0.647s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:32 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095
Apr 08 11:05:32 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (680ffe07-cc58-4b67-afed-ca575061022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005857d0-e543-4cd0-86b5-3de24d687b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005857d0-e543-4cd0-86b5-3de24d687b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521627921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04db773-f41e-4f6d-9e61-833232bbac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:32Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8aa50e-f26d-49a2-b96f-bf2248b93f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8aa50e-f26d-49a2-b96f-bf2248b93f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8954de6-a836-44e8-b708-498decc91a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8954de6-a836-44e8-b708-498decc91a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04db773-f41e-4f6d-9e61-833232bbac42', 'volume_name': 'volume-f04db773-f41e-4f6d-9e61-833232bbac42', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e442255-1162-4d44-9054-b4e2c2e1c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e442255-1162-4d44-9054-b4e2c2e1c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0be851-ae2c-4fb0-b48b-dbdfc4abae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Volume f04db773-f41e-4f6d-9e61-833232bbac42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04db773-f41e-4f6d-9e61-833232bbac42', 'volume_size': 1}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:32 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521627921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04db773-f41e-4f6d-9e61-833232bbac42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:32Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Creating volume f04db773-f41e-4f6d-9e61-833232bbac42 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:32 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01f4572-668a-4047-ac12-599def28e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a68bcc-5a69-447e-8c10-478aefc52095', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack sudo[86623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 1073741824
Apr 08 11:05:32 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc8efe8-3a6f-4040-8497-5ffa6f8a0bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Volume volume-d6a68bcc-5a69-447e-8c10-478aefc52095 (d6a68bcc-5a69-447e-8c10-478aefc52095): created successfully
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc8efe8-3a6f-4040-8497-5ffa6f8a0bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Flow 'volume_create_manager' (3dba609c-9476-45d9-8788-bf5c09ad40a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0bdc127d-c111-473a-8b26-97f2e978a4cd tempest-VolumesGetTest-394513138 None] Created volume successfully.
Apr 08 11:05:33 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 1073741824" returned: 0 in 0.696s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:UPDATE=146,cinder:DELETE=12,cinder:SELECT=135,cinder:INSERT=57 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:33 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42
Apr 08 11:05:33 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-d6a68bcc-5a69-447e-8c10-478aefc52095-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "cinder-d6a68bcc-5a69-447e-8c10-478aefc52095-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-d6a68bcc-5a69-447e-8c10-478aefc52095" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-d6a68bcc-5a69-447e-8c10-478aefc52095" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[43deca3c-9c00-4a42-bb3f-d6a5a09fbe9c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:33 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42" returned: 0 in 0.540s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0be851-ae2c-4fb0-b48b-dbdfc4abae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04db773-f41e-4f6d-9e61-833232bbac42', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b7a46a-4d7f-414e-adaa-95937e0313af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=113,cinder:UPDATE=163,cinder:DELETE=16,cinder:INSERT=37 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:05:33 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095
Apr 08 11:05:33 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:33 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Volume volume-f04db773-f41e-4f6d-9e61-833232bbac42 (f04db773-f41e-4f6d-9e61-833232bbac42): created successfully
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b7a46a-4d7f-414e-adaa-95937e0313af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:33 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (680ffe07-cc58-4b67-afed-ca575061022f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0ee421a2-9727-41d8-aeec-23857c3f006e tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-f04db773-f41e-4f6d-9e61-833232bbac42-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-f04db773-f41e-4f6d-9e61-833232bbac42-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-quobyte-f04db773-f41e-4f6d-9e61-833232bbac42" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-f04db773-f41e-4f6d-9e61-833232bbac42" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:34 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095" returned: 0 in 0.707s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f559dfa3-7ea9-4e5e-9fe1-68931e751159]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:34 devstack sudo[86662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095
Apr 08 11:05:34 devstack sudo[86662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:34 devstack sudo[86664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42
Apr 08 11:05:34 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:35 devstack sudo[86662]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d6a68bcc-5a69-447e-8c10-478aefc52095" returned: 0 in 0.503s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-d6a68bcc-5a69-447e-8c10-478aefc52095" released by "delete_volume" :: held 1.264s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:35 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Created reservations ['bc1b01b4-8e5c-43ba-b123-1e7e9c6da77d', 'ff24015e-d163-4c5e-a59e-d4403280c7cc', 'ecdf07c1-73ed-4eb3-ba49-0cdc0994ebb5', '73b96c38-8094-406f-9ede-7b090fbdd5b1'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:35 devstack sudo[86670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42
Apr 08 11:05:35 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:35 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:35 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:35 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f04db773-f41e-4f6d-9e61-833232bbac42" returned: 0 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-f04db773-f41e-4f6d-9e61-833232bbac42" released by "delete_volume" :: held 1.146s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Created reservations ['e4ba68ba-1283-4c1d-b22a-bca9eb430b5e', '290e55b4-427e-4b1a-b6e5-75499cadea41', '2516f321-1dbd-499f-830f-b81725427f96', 'c30baa53-ed40-4f76-966c-7d44360f4037'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:35 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.592s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2f58dcf5-e606-49d5-a304-eae072c6c5a0 tempest-VolumesGetTest-394513138 None] Lock "cinder-d6a68bcc-5a69-447e-8c10-478aefc52095-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:35 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:35 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-fb057a71-973a-424d-956c-6ba94f2c527e-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "cinder-fb057a71-973a-424d-956c-6ba94f2c527e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Acquiring lock "cinder-quobyte-fb057a71-973a-424d-956c-6ba94f2c527e" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-fb057a71-973a-424d-956c-6ba94f2c527e" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b26d0-6ce9-4cd8-9ab1-8e7889ad9c94]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:36 devstack sudo[86693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:36 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:36 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.533s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Deleted volume successfully.
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-81b339cc-dbc0-478c-917a-555e80d90291 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-f04db773-f41e-4f6d-9e61-833232bbac42-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:36 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 0 in 0.531s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:36 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:36 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (327965f9-b22e-439a-9f3b-b41c4a41583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79575c3-322c-43a1-84fd-e4b94262b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Acquiring lock "cinder-10c1132b-8915-4059-bbdf-1d5804414b3c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79575c3-322c-43a1-84fd-e4b94262b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262819030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f0a984-9aca-4e7b-be3c-f6137817bff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:37Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d040e4-bef8-476d-884f-77895f79a597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d040e4-bef8-476d-884f-77895f79a597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484f4568-7bba-4edc-9bb6-1434eff0e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484f4568-7bba-4edc-9bb6-1434eff0e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f0a984-9aca-4e7b-be3c-f6137817bff8', 'volume_name': 'volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95caf84-39db-44fa-a40a-b3ca7f0c7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:37 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95caf84-39db-44fa-a40a-b3ca7f0c7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a9695-a40b-4f62-bdb7-41c94a29ca12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:37 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Volume d4f0a984-9aca-4e7b-be3c-f6137817bff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8', 'volume_size': 1}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262819030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f0a984-9aca-4e7b-be3c-f6137817bff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:37Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Creating volume d4f0a984-9aca-4e7b-be3c-f6137817bff8 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:37 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 1 in 0.673s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:37 devstack sudo[86736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 1073741824
Apr 08 11:05:37 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "cinder-10c1132b-8915-4059-bbdf-1d5804414b3c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:37 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Acquiring lock "cinder-quobyte-10c1132b-8915-4059-bbdf-1d5804414b3c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:37 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "cinder-quobyte-10c1132b-8915-4059-bbdf-1d5804414b3c" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbf3ecf-8977-4e12-b82d-dc736d467f5b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:37 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c
Apr 08 11:05:37 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:37 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 1073741824" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:37 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fb057a71-973a-424d-956c-6ba94f2c527e" returned: 0 in 0.516s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "cinder-quobyte-fb057a71-973a-424d-956c-6ba94f2c527e" released by "delete_volume" :: held 1.768s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:37 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8
Apr 08 11:05:37 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Created reservations ['955787fa-970a-49fe-a66f-f9feb3720f9d', '64feec58-09a6-4201-978b-ea7bbcb3fbcc', '00e54eb1-93be-42a8-bb66-f832ae2040e2', '49292e0a-fd17-4146-9672-c0b10d0822db'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:37 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c" returned: 0 in 0.512s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:37 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c
Apr 08 11:05:37 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:38 devstack sudo[86769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:38 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:38 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119a9695-a40b-4f62-bdb7-41c94a29ca12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1443644-d1e0-4d42-b870-8c343ea79376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:38 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Volume volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 (d4f0a984-9aca-4e7b-be3c-f6137817bff8): created successfully
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1443644-d1e0-4d42-b870-8c343ea79376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (327965f9-b22e-439a-9f3b-b41c4a41583e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9353c221-0f16-459d-80df-0ea30abde763 tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:38 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-10c1132b-8915-4059-bbdf-1d5804414b3c" returned: 0 in 0.550s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "cinder-quobyte-10c1132b-8915-4059-bbdf-1d5804414b3c" released by "delete_volume" :: held 1.089s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Created reservations ['1b65039c-f9f4-4d9f-b910-abf2cc90d0c1', '95432c3c-72c8-404b-92bc-81a28fa62bf3', '600fd878-a4dd-44bb-ab0e-28bcd4fef50c', '051e7af4-ce56-4292-ac0d-9eeeb12d9740'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:38 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Deleted volume successfully.
Apr 08 11:05:38 devstack sudo[86774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:38 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-baa9e715-0755-4d83-a94d-32f4251e2789 tempest-VolumesGetTest-394513138 None] Lock "cinder-fb057a71-973a-424d-956c-6ba94f2c527e-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:39 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Deleted volume successfully.
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c99aa1de-9efb-4770-9734-487ea7b48248 tempest-VolumesNegativeTest-1738632939 None] Lock "cinder-10c1132b-8915-4059-bbdf-1d5804414b3c-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-d4f0a984-9aca-4e7b-be3c-f6137817bff8-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-d4f0a984-9aca-4e7b-be3c-f6137817bff8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "cinder-quobyte-d4f0a984-9aca-4e7b-be3c-f6137817bff8" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-d4f0a984-9aca-4e7b-be3c-f6137817bff8" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997cffe-d20f-4312-b55d-ae1200e3094d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:39 devstack sudo[86778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8
Apr 08 11:05:39 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (c1c35e21-c38a-4b83-bc28-cfff4a99c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bca8b66-1461-49a4-a599-ae420ac11742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bca8b66-1461-49a4-a599-ae420ac11742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164565118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb04ea4-c356-42e2-a49a-7dcc390d83d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:40Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1e1ce2-7c7a-40cb-a18d-cb345bd74f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1e1ce2-7c7a-40cb-a18d-cb345bd74f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250c618-ef7e-420d-81f2-d6014f3abf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250c618-ef7e-420d-81f2-d6014f3abf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb04ea4-c356-42e2-a49a-7dcc390d83d0', 'volume_name': 'volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf71236f-201e-41cc-a168-3bbe09b86f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf71236f-201e-41cc-a168-3bbe09b86f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42880c9-cf68-4235-9038-db53149b7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:40 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Volume edb04ea4-c356-42e2-a49a-7dcc390d83d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0', 'volume_size': 1}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164565118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb04ea4-c356-42e2-a49a-7dcc390d83d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:40Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Creating volume edb04ea4-c356-42e2-a49a-7dcc390d83d0 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:40 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:40 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8" returned: 0 in 0.666s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:40 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 1073741824
Apr 08 11:05:40 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:40 devstack sudo[86802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8
Apr 08 11:05:40 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:41 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 1073741824" returned: 0 in 0.881s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:41 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d4f0a984-9aca-4e7b-be3c-f6137817bff8" returned: 0 in 0.906s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-quobyte-d4f0a984-9aca-4e7b-be3c-f6137817bff8" released by "delete_volume" :: held 1.618s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:41 devstack sudo[86819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0
Apr 08 11:05:41 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Created reservations ['1c8fef3e-4637-4029-93dc-7f0d56cb7b17', '39a23592-548d-4679-9bd0-29adb4ed2e58', 'ed4e89fd-e7b2-4526-ae83-26f82c4be465', '218079eb-b901-4ac4-8dbe-791f7f92f868'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:41 devstack sudo[86821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:41 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Flow 'volume_create_manager' (32e10de2-1925-4078-a45d-834b6f9d7903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de8518-402c-4cef-b27b-70841261ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de8518-402c-4cef-b27b-70841261ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1793446508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54a90fc-5aee-43e7-9e42-702ea669f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a413dec4d842f69923151889e09607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:42Z,use_quota=True,user_id='c5f4cce6d7ce47959a889a48dcd33eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cc0ba8-8299-4a6f-bb4b-603b6ade0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8cc0ba8-8299-4a6f-bb4b-603b6ade0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45d7433-81cf-45bf-b0bc-3947bfc70bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45d7433-81cf-45bf-b0bc-3947bfc70bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54a90fc-5aee-43e7-9e42-702ea669f065', 'volume_name': 'volume-a54a90fc-5aee-43e7-9e42-702ea669f065', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc58f2-370d-43bf-bc1c-a329fc622e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bc58f2-370d-43bf-bc1c-a329fc622e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9800ca3-9419-418f-89e5-0921691d46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Volume a54a90fc-5aee-43e7-9e42-702ea669f065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54a90fc-5aee-43e7-9e42-702ea669f065', 'volume_size': 1}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:41 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0" returned: 0 in 0.585s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1793446508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54a90fc-5aee-43e7-9e42-702ea669f065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a413dec4d842f69923151889e09607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:42Z,use_quota=True,user_id='c5f4cce6d7ce47959a889a48dcd33eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Creating volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:41 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:41 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.496s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:41 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 1073741824
Apr 08 11:05:41 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42880c9-cf68-4235-9038-db53149b7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae64617-ec5a-4126-b50d-bd0602eb95cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Deleted volume successfully.
Apr 08 11:05:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Volume volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 (edb04ea4-c356-42e2-a49a-7dcc390d83d0): created successfully
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae64617-ec5a-4126-b50d-bd0602eb95cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (c1c35e21-c38a-4b83-bc28-cfff4a99c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-787de1c1-1525-419b-a6a2-1b2fbb7a7d97 tempest-VolumesActionsTest-1513342221 None] Lock "cinder-d4f0a984-9aca-4e7b-be3c-f6137817bff8-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e97c14d2-9169-456b-a55b-2a67ab139e56 tempest-VolumesListTestJSON-1301028461 None] Created volume successfully.
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (e28deaa0-98d9-479e-b5f7-58f4b707e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6368520-205f-44eb-8f8b-41314832b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6368520-205f-44eb-8f8b-41314832b471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167192294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:42Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb196da3-e73a-4306-9537-888685afb308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb196da3-e73a-4306-9537-888685afb308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd6b05b-7a78-4914-947f-782bb092457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd6b05b-7a78-4914-947f-782bb092457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09', 'volume_name': 'volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d13e53e-0f2d-44a4-b044-eb4c2c72b783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d13e53e-0f2d-44a4-b044-eb4c2c72b783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2a56e4-0f3e-4243-9e22-2a608173520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Volume 243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09', 'volume_size': 1}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:42 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 1073741824" returned: 0 in 0.713s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:42 devstack sudo[86832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065
Apr 08 11:05:42 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (ded9848f-0e18-41bc-894e-ca2102fb89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ea809-3f95-437b-9920-c5c70b08bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745ea809-3f95-437b-9920-c5c70b08bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1865281794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1a2757-eb62-4355-94f5-c6e9ce59c10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:43Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bc47f6-ece6-423d-bdb1-eee3ab2c2221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bc47f6-ece6-423d-bdb1-eee3ab2c2221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748ae95b-61bd-43e6-bbaa-4c435077f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748ae95b-61bd-43e6-bbaa-4c435077f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1a2757-eb62-4355-94f5-c6e9ce59c10d', 'volume_name': 'volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430c83d-39bb-40a1-88d5-54a3c2f1c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430c83d-39bb-40a1-88d5-54a3c2f1c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c5533c-120c-4d8b-ac2b-6d2528591222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Volume 4a1a2757-eb62-4355-94f5-c6e9ce59c10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d', 'volume_size': 1}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:42 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167192294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fefe5873b6421ea3e1b217a629840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:42Z,use_quota=True,user_id='33aee081e5b14ed9b04dd9cfea7a9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Creating volume 243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:42 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:42 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 1073741824
Apr 08 11:05:42 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9800ca3-9419-418f-89e5-0921691d46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54a90fc-5aee-43e7-9e42-702ea669f065', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874fe4c4-9cf8-47ef-ae56-3832cec4cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Volume volume-a54a90fc-5aee-43e7-9e42-702ea669f065 (a54a90fc-5aee-43e7-9e42-702ea669f065): created successfully
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874fe4c4-9cf8-47ef-ae56-3832cec4cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Flow 'volume_create_manager' (32e10de2-1925-4078-a45d-834b6f9d7903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-373bd541-aacf-4486-ace0-2196fdb68bf7 tempest-VolumesSnapshotListTestJSON-836957919 None] Created volume successfully.
Apr 08 11:05:43 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 1073741824" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:43 devstack sudo[86841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09
Apr 08 11:05:43 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:43 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" returned: 0 in 0.509s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1865281794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1a2757-eb62-4355-94f5-c6e9ce59c10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:43Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Creating volume 4a1a2757-eb62-4355-94f5-c6e9ce59c10d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:43 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2a56e4-0f3e-4243-9e22-2a608173520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:43 devstack sudo[86844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d 1073741824
Apr 08 11:05:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1830f1ac-2444-4f73-82a1-b5d9f8c8abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:43 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:44 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Volume volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 (243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09): created successfully
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1830f1ac-2444-4f73-82a1-b5d9f8c8abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Flow 'volume_create_manager' (e28deaa0-98d9-479e-b5f7-58f4b707e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:44 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d79b3792-7d3b-43df-866a-f8db35bcbc53 tempest-VolumesActionsTest-1227534448 None] Created volume successfully.
Apr 08 11:05:44 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d 1073741824" returned: 0 in 0.568s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:44 devstack sudo[86849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d
Apr 08 11:05:44 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "cinder-quobyte-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-quobyte-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8abd4ea-56b2-4c1b-81ea-8e23ba223c9c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:44 devstack sudo[86851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09
Apr 08 11:05:44 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:45 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" returned: 0 in 0.564s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.241s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Creating offline snapshot faf5be5a-b4e8-4296-91c8-1cdc128e57a1 of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c5533c-120c-4d8b-ac2b-6d2528591222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1607df0-455d-492c-8ed2-1ddd2656f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[613691d3-f395-4915-a9ca-2c0d260591ae]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:45 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Volume volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d (4a1a2757-eb62-4355-94f5-c6e9ce59c10d): created successfully
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1607df0-455d-492c-8ed2-1ddd2656f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (ded9848f-0e18-41bc-894e-ca2102fb89a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:45 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2dba77a3-0597-4c2d-bb6e-46e0f14e7c95 tempest-VolumesListTestJSON-1301028461 None] Created volume successfully.
Apr 08 11:05:45 devstack sudo[86877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065
Apr 08 11:05:45 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:45 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" returned: 0 in 0.647s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:45 devstack sudo[86883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09
Apr 08 11:05:45 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:45 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065" returned: 0 in 0.595s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:45 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 1G
Apr 08 11:05:45 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:46 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" returned: 0 in 0.632s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-quobyte-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09" released by "delete_volume" :: held 1.315s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Created reservations ['5dbeccbb-b359-4215-a9c8-b77d49737480', 'e6fa4486-e23a-45ce-8850-aca03bfad479', 'b854fa85-8213-4b61-9bb9-dd1d55eaf9f4', 'c46878fb-5b4b-4275-9c22-740cc2d57b2a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:46 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:46 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (c11a9208-d27b-4d37-9fd5-38cde5971b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc057fa-3ca2-4a67-82f8-03cea85f7274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc057fa-3ca2-4a67-82f8-03cea85f7274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1193069628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a12877-286e-4d9f-9cf0-87ec1382aeb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:46Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fd599d-c96c-493b-bc56-97f594977a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fd599d-c96c-493b-bc56-97f594977a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0752dff-cfd0-4e2f-ae21-463bc17ba0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0752dff-cfd0-4e2f-ae21-463bc17ba0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a12877-286e-4d9f-9cf0-87ec1382aeb5', 'volume_name': 'volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e5fd50-20f3-4f47-9b98-fe9b524d744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e5fd50-20f3-4f47-9b98-fe9b524d744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746f06f2-08d8-4dda-98c2-17030296645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:46 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Volume 82a12877-286e-4d9f-9cf0-87ec1382aeb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5', 'volume_size': 1}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:46 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 1G" returned: 0 in 0.871s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:46 devstack sudo[86918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:05:46 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:46 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.663s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:46 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Deleted volume successfully.
Apr 08 11:05:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1abfa71b-750f-4b76-af95-7c520d1b7ec5 tempest-VolumesActionsTest-1227534448 None] Lock "cinder-243ddfbc-56a5-4cdf-8eca-cd20a0cd7a09-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:47 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.555s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:47 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 is being set with open permissions: ugo+rw
Apr 08 11:05:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:47 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:05:47 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:47 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:47 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info
Apr 08 11:05:47 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:48 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info" returned: 0 in 0.601s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:48 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info is being set with open permissions: ugo+rw
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:48 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info
Apr 08 11:05:48 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:48 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.info" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.713s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.269s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1193069628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a12877-286e-4d9f-9cf0-87ec1382aeb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bcc41748c7ca40649f1113dd4345897b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:46Z,use_quota=True,user_id='b7015c95e87d4dbebd15137aa299589c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Creating volume 82a12877-286e-4d9f-9cf0-87ec1382aeb5 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:48 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:48 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 1073741824
Apr 08 11:05:48 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:48 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-448568fb-24a7-4b1a-82d7-6ff8b79a3bd9 tempest-VolumesSnapshotListTestJSON-836957919 None] Create snapshot completed successfully
Apr 08 11:05:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:49 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 1073741824" returned: 0 in 0.639s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:49 devstack sudo[86959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5
Apr 08 11:05:49 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:50 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5" returned: 0 in 0.569s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746f06f2-08d8-4dda-98c2-17030296645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6157738-9e5b-4e6b-84d2-1eebbd9979b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:50 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Volume volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 (82a12877-286e-4d9f-9cf0-87ec1382aeb5): created successfully
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6157738-9e5b-4e6b-84d2-1eebbd9979b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Flow 'volume_create_manager' (c11a9208-d27b-4d37-9fd5-38cde5971b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Creating offline snapshot b28ef766-9390-4356-8422-6ef4fd96d08c of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:05:50 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9a706eac-1ff1-43a5-89d7-2070ccd49864 tempest-VolumesListTestJSON-1301028461 None] Created volume successfully.
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b2e0d-cce2-4c70-8e8f-7d7e11c7e6ef]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:50 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:05:50 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:50 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.602s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:50 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c 1G
Apr 08 11:05:50 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:51 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c 1G" returned: 0 in 0.533s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:51 devstack sudo[86983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:05:51 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:51 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-e60c3a08-5438-44cd-99d5-20718ca457b1 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Terminate volume connection completed successfully.
Apr 08 11:05:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-e60c3a08-5438-44cd-99d5-20718ca457b1 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Deleting attachment a2db78b5-1b87-4c68-bdb3-521681a7c194. {{(pid=82670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 08 11:05:51 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:51 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c is being set with open permissions: ugo+rw
Apr 08 11:05:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:51 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:05:51 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:52 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.521s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-01b171bc-fba9-4be9-a7be-c7e77939555a tempest-VolumesSnapshotListTestJSON-836957919 None] Create snapshot completed successfully
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "cinder-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "cinder-quobyte-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-quobyte-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dbfffc-f9d1-4acc-b81d-a13a43cd0a03]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:52 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:52 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-82a12877-286e-4d9f-9cf0-87ec1382aeb5-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-82a12877-286e-4d9f-9cf0-87ec1382aeb5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Creating offline snapshot 8357da21-1bf6-42cd-b658-1bfef537d58c of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb4d8a-a1b8-407f-a35a-95adb4eae527]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-quobyte-82a12877-286e-4d9f-9cf0-87ec1382aeb5" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-82a12877-286e-4d9f-9cf0-87ec1382aeb5" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0c359e-8d6f-48bf-8f0b-fc72c61bdabe]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:52 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:05:52 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:52 devstack sudo[86997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5
Apr 08 11:05:52 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:53 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 0.655s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:53 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:53 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:53 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5" returned: 0 in 0.604s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:53 devstack sudo[87010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5
Apr 08 11:05:53 devstack sudo[87010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:53 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.700s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:53 devstack sudo[87012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c 1G
Apr 08 11:05:53 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:53 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 1 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:53 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf
Apr 08 11:05:53 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:53 devstack sudo[87010]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-82a12877-286e-4d9f-9cf0-87ec1382aeb5" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-82a12877-286e-4d9f-9cf0-87ec1382aeb5" released by "delete_volume" :: held 1.180s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Created reservations ['c5324fa5-2103-4dbe-a4f5-78a2c9367b0e', '45cbfec3-77ad-49d5-a5f3-fa982c08c19d', '48626985-b2ef-4458-94c0-a2cdbde17749', 'f69a4ebe-2614-434b-aafa-aad586158568'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:54 devstack sudo[87024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:54 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:54 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c 1G" returned: 0 in 0.685s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:54 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c
Apr 08 11:05:54 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:54 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" returned: 0 in 0.568s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-quobyte-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf" released by "delete_volume" :: held 1.862s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.quota [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Created reservations ['a7e02b01-31ac-44ab-acff-7e6ff912ab6a', '02fe94ea-d606-40f5-8961-3cd51bbb9c66', 'aec8bd64-35d2-41e7-a6d0-d1fdc00a1310', 'd9fa12d8-1480-4431-9929-9bb609e34fb4'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:54 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:54 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:54 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Deleted volume successfully.
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1cb1073b-899b-446d-a27a-db05fe319def tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-82a12877-286e-4d9f-9cf0-87ec1382aeb5-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:54 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:54 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c is being set with open permissions: ugo+rw
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:54 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c
Apr 08 11:05:54 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:54 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.511s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.manager [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-4a1a2757-eb62-4355-94f5-c6e9ce59c10d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Deleted volume successfully.
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-4a1a2757-eb62-4355-94f5-c6e9ce59c10d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-3786a012-0db2-4efc-8850-24f25f7aa667 req-be33fe9c-ba0b-4e50-88a7-f190ce528e21 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-1abb5220-1aac-427b-8ee5-2ad5a1a8bebf-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-quobyte-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e8f24c-f02c-48ed-beab-72e0e3ab654f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:55 devstack sudo[87038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d
Apr 08 11:05:55 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:55 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c" returned: 0 in 0.504s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-639219d7-54cf-4005-b9cd-a771db689a23 tempest-VolumesSnapshotListTestJSON-836957919 None] Create snapshot completed successfully
Apr 08 11:05:55 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" returned: 0 in 0.595s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:55 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d
Apr 08 11:05:55 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (ce66adc5-f89b-4852-8376-3fad79cbbf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6a8abf-a3cf-444d-a535-d50f300647e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6a8abf-a3cf-444d-a535-d50f300647e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2054076889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3296a10-d7e3-43cf-b881-ce99920e93c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760b301bdeb487f8dc8228cc4763be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:56Z,use_quota=True,user_id='f4a0928fa623476eb28c8febf206af15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43690b82-5cfd-4866-b84c-b74905b6af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43690b82-5cfd-4866-b84c-b74905b6af75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b597159e-57cd-43cd-9447-2e675e1c6fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b597159e-57cd-43cd-9447-2e675e1c6fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3296a10-d7e3-43cf-b881-ce99920e93c3', 'volume_name': 'volume-f3296a10-d7e3-43cf-b881-ce99920e93c3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed45fa9a-4dfc-4ae7-a047-2a2075b905b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed45fa9a-4dfc-4ae7-a047-2a2075b905b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe15a6f-2be9-4ad5-9d9b-f96a1da88b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:55 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Volume f3296a10-d7e3-43cf-b881-ce99920e93c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3296a10-d7e3-43cf-b881-ce99920e93c3', 'volume_size': 1}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2054076889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3296a10-d7e3-43cf-b881-ce99920e93c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760b301bdeb487f8dc8228cc4763be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:05:56Z,use_quota=True,user_id='f4a0928fa623476eb28c8febf206af15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Creating volume f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:05:55 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:05:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:55 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 1073741824
Apr 08 11:05:55 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:56 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" returned: 0 in 0.519s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-4a1a2757-eb62-4355-94f5-c6e9ce59c10d" released by "delete_volume" :: held 1.143s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Created reservations ['37798324-2574-421e-81da-b8be2daab836', '29f444cd-69b9-4fd9-bda4-089223c68ff7', 'e16c1379-27e6-41e9-a15b-bdc0c7138805', '5117d855-cc35-468d-89e5-9e27d0237005'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:56 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:56 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-8357da21-1bf6-42cd-b658-1bfef537d58c-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-8357da21-1bf6-42cd-b658-1bfef537d58c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:56 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-8357da21-1bf6-42cd-b658-1bfef537d58c" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 1073741824" returned: 0 in 0.648s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-8357da21-1bf6-42cd-b658-1bfef537d58c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Deleting offline snapshot 8357da21-1bf6-42cd-b658-1bfef537d58c of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] snapshot_file for this snap is: volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb82932-b719-43e7-b1ad-bdc4a52872b6]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:56 devstack sudo[87056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:05:56 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:56 devstack sudo[87055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c
Apr 08 11:05:56 devstack sudo[87055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:56 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.542s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Deleted volume successfully.
Apr 08 11:05:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-bbb00509-b3b7-45e8-87a5-a3b16bcdbe4d tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-4a1a2757-eb62-4355-94f5-c6e9ce59c10d-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:57 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe15a6f-2be9-4ad5-9d9b-f96a1da88b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3296a10-d7e3-43cf-b881-ce99920e93c3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac06ce-46ac-439a-840d-41ac488e4340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:05:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Volume volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 (f3296a10-d7e3-43cf-b881-ce99920e93c3): created successfully
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ac06ce-46ac-439a-840d-41ac488e4340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (ce66adc5-f89b-4852-8376-3fad79cbbf49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:05:57 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6211fb05-36d4-4efc-b086-5a576a5f316a tempest-VolumesDeleteCascade-1804139365 None] Created volume successfully.
Apr 08 11:05:57 devstack sudo[87055]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c" returned: 0 in 0.638s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-edb04ea4-c356-42e2-a49a-7dcc390d83d0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[84948a9c-042d-49d8-ba9a-a539096abe40]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-edb04ea4-c356-42e2-a49a-7dcc390d83d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "cinder-quobyte-edb04ea4-c356-42e2-a49a-7dcc390d83d0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-edb04ea4-c356-42e2-a49a-7dcc390d83d0" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6049b8f9-befa-499d-9049-08bf60306c53]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:57 devstack sudo[87091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:05:57 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:57 devstack sudo[87093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0
Apr 08 11:05:57 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:57 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.513s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:57 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c
Apr 08 11:05:57 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:57 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:57 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0
Apr 08 11:05:57 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Creating offline snapshot 66bf351c-4646-4be2-85a5-d10eebf3d3df of volume f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[830e4095-5238-48ae-957a-80ba1279148d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:58 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:05:58 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:58 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-edb04ea4-c356-42e2-a49a-7dcc390d83d0" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-quobyte-edb04ea4-c356-42e2-a49a-7dcc390d83d0" released by "delete_volume" :: held 0.932s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Created reservations ['4724b61f-6b12-4a26-965d-a98936205184', '224ea77f-7f13-42f0-86b3-b720340e0c38', '216bf4b3-b807-48c9-adbd-6e9f4fcfd423', 'dd0418ee-e705-4b6c-a28c-c7e21159c5ae'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:58 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:58 devstack sudo[87113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c
Apr 08 11:05:58 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:58 devstack sudo[87115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:05:58 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:58 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.601s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:58 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df 1G
Apr 08 11:05:58 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:58 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.8357da21-1bf6-42cd-b658-1bfef537d58c" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:58 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-8357da21-1bf6-42cd-b658-1bfef537d58c" released by "_delete_snapshot" :: held 2.270s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" released by "delete_snapshot" :: held 2.294s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Deleted volume successfully.
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d29ebc7b-bc70-493e-801b-c4e1f8223899 tempest-VolumesListTestJSON-1301028461 None] Lock "cinder-edb04ea4-c356-42e2-a49a-7dcc390d83d0-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Created reservations ['0234aa24-a99f-42be-8c48-ecb2c86487fe', 'bc26c9e8-ea42-438e-a82a-3647e6409125', '48b7daf6-63ce-478d-aa52-f9e4b9b1ae00', '0aa7e70c-6763-46a8-b3c0-3e53d9d4d677'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:05:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Delete snapshot completed successfully.
Apr 08 11:05:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-da071799-12a8-4c8c-8d0b-d8fb55227c5c tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-8357da21-1bf6-42cd-b658-1bfef537d58c-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:05:59 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df 1G" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:59 devstack sudo[87129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:05:59 devstack sudo[87129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:59 devstack sudo[87129]: pam_unix(sudo:session): session closed for user root
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-b28ef766-9390-4356-8422-6ef4fd96d08c-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.499s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:05:59 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df is being set with open permissions: ugo+rw
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-b28ef766-9390-4356-8422-6ef4fd96d08c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:59 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:05:59 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-b28ef766-9390-4356-8422-6ef4fd96d08c" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-b28ef766-9390-4356-8422-6ef4fd96d08c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Deleting offline snapshot b28ef766-9390-4356-8422-6ef4fd96d08c of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] snapshot_file for this snap is: volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9de2b2-91b0-4d09-9865-434f8882fc5b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:05:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:05:59 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:05:59 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:00 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.516s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:00 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info
Apr 08 11:06:00 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:00 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.554s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcb75d-8592-4a0c-98e4-7da5cbe3e20a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:00 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:06:00 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:00 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info" returned: 0 in 0.446s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:00 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info is being set with open permissions: ugo+rw
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:00 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info
Apr 08 11:06:00 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:00 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.560s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:00 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:06:00 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:01 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.info" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:01 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1b7711b5-25ca-4c50-986f-b786c091f1ab tempest-VolumesDeleteCascade-1804139365 None] Create snapshot completed successfully
Apr 08 11:06:01 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.567s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:01 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c
Apr 08 11:06:01 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:01 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.b28ef766-9390-4356-8422-6ef4fd96d08c" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-b28ef766-9390-4356-8422-6ef4fd96d08c" released by "_delete_snapshot" :: held 2.208s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" released by "delete_snapshot" :: held 2.221s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Created reservations ['42c10cca-e67d-4598-9798-572e344d84fe', 'f9b4dbf3-ed21-4ea7-a003-4e55f49455b5', '0c0ea964-93d5-4cbd-89f8-09d283195e65', 'ff94d417-c40a-485b-9de3-bf7340181c18'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:01 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Delete snapshot completed successfully.
Apr 08 11:06:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3aca6cb5-3535-4d34-8cd2-f554d1375f1a tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-b28ef766-9390-4356-8422-6ef4fd96d08c-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Creating offline snapshot d08daf91-6d74-45c0-b97c-cc41e02d7246 of volume f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3c464a-b5cf-4e6e-935e-44b0be8b77eb]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:02 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:06:02 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:02 devstack sudo[87165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:02 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-faf5be5a-b4e8-4296-91c8-1cdc128e57a1-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-faf5be5a-b4e8-4296-91c8-1cdc128e57a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-faf5be5a-b4e8-4296-91c8-1cdc128e57a1" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-faf5be5a-b4e8-4296-91c8-1cdc128e57a1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Deleting offline snapshot faf5be5a-b4e8-4296-91c8-1cdc128e57a1 of volume a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:02 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] snapshot_file for this snap is: volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.527s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3296a10-d7e3-43cf-b881-ce99920e93c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b4f61-b181-4c07-b0ed-d2174173a55b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:02 devstack sudo[87170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 1G
Apr 08 11:06:02 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:02 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:06:02 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:03 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:03 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 1G" returned: 0 in 0.695s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:03 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:03 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:03 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.735s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a54a90fc-5aee-43e7-9e42-702ea669f065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdafbd8f-fe6d-4f59-9bfa-78bb199c16a1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:03 devstack sudo[87209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065
Apr 08 11:06:03 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:04 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.511s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:04 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 is being set with open permissions: ugo+rw
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:04 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:04 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:04 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:04 devstack sudo[87220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:06:04 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:04 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.559s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c2b3467d-4c3f-47bd-a370-f41b39813b96 tempest-VolumesDeleteCascade-1804139365 None] Create snapshot completed successfully
Apr 08 11:06:04 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.581s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:04 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1
Apr 08 11:06:04 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:05 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065.faf5be5a-b4e8-4296-91c8-1cdc128e57a1" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-faf5be5a-b4e8-4296-91c8-1cdc128e57a1" released by "_delete_snapshot" :: held 2.388s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" released by "delete_snapshot" :: held 2.406s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Created reservations ['b8066535-b591-4eb1-bcc6-119b91a1fdc7', '3e51de34-20cf-43e6-a0cd-3dae43277f92', 'ebdb8835-190c-425c-bef3-25e824e785a2', '733af9f2-d1d3-4aba-a07f-ea081a727096'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Delete snapshot completed successfully.
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ebc2cca-153d-481b-93e0-0083bfb2a7e9 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-faf5be5a-b4e8-4296-91c8-1cdc128e57a1-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-f3296a10-d7e3-43cf-b881-ce99920e93c3-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-f3296a10-d7e3-43cf-b881-ce99920e93c3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Performing cascade delete. {{(pid=82670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-66bf351c-4646-4be2-85a5-d10eebf3d3df-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-66bf351c-4646-4be2-85a5-d10eebf3d3df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-66bf351c-4646-4be2-85a5-d10eebf3d3df" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-66bf351c-4646-4be2-85a5-d10eebf3d3df" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Deleting offline snapshot 66bf351c-4646-4be2-85a5-d10eebf3d3df of volume f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] snapshot_file for this snap is: volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac76bf4-1256-4ff7-aa1b-47fa50284d22]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:05 devstack sudo[87232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:06:05 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-c0518254-2a94-40e5-9c22-6677f6810767 req-e2d04a18-1661-4f86-b262-abda78b1b329 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Terminate volume connection completed successfully.
Apr 08 11:06:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [req-c0518254-2a94-40e5-9c22-6677f6810767 req-e2d04a18-1661-4f86-b262-abda78b1b329 tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Deleting attachment d002bf7c-2146-4f46-9301-da162606fc11. {{(pid=82670) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-a54a90fc-5aee-43e7-9e42-702ea669f065-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-a54a90fc-5aee-43e7-9e42-702ea669f065-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd3780-ce83-4b9c-9bd6-dea1eb121716]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:06 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.602s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3296a10-d7e3-43cf-b881-ce99920e93c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44e7264-6dd6-4755-8f7c-500f565704dd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:06 devstack sudo[87237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065
Apr 08 11:06:06 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:06 devstack sudo[87238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:06:06 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "cinder-62c46152-507c-400c-9c3a-daf3614913e0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-62c46152-507c-400c-9c3a-daf3614913e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "cinder-quobyte-62c46152-507c-400c-9c3a-daf3614913e0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-quobyte-62c46152-507c-400c-9c3a-daf3614913e0" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0914a8d-a9cb-4432-bfdd-bd81ca7f0df1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:06 devstack sudo[87241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0
Apr 08 11:06:06 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:06 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.596s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:06 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065" returned: 0 in 0.694s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a46793c-6b5c-4d5f-9d1e-8f337536e59a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:06 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065
Apr 08 11:06:06 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:06 devstack sudo[87250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:06 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:06 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0" returned: 0 in 0.555s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:07 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0
Apr 08 11:06:07 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:07 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a54a90fc-5aee-43e7-9e42-702ea669f065" returned: 0 in 0.665s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-quobyte-a54a90fc-5aee-43e7-9e42-702ea669f065" released by "delete_volume" :: held 1.422s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:07 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:07 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-62c46152-507c-400c-9c3a-daf3614913e0" returned: 0 in 0.578s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Created reservations ['3cfb4223-54e4-4f78-a1f6-e2997cc5862e', '551b7d97-8db2-4f54-9ef9-88e88496ab76', 'ba5d2210-1707-4a5b-b8f7-76b9c487ca08', '86df516d-9247-46f0-9a1e-ddbd3004dd1c'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.764s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3296a10-d7e3-43cf-b881-ce99920e93c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-quobyte-62c46152-507c-400c-9c3a-daf3614913e0" released by "delete_volume" :: held 1.170s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddbf47-ff07-46a9-a86f-488bec5d0662]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.quota [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Created reservations ['6878135c-88c8-4f66-adee-2d6264f81ba1', '530c9a4a-ad68-4225-aacf-a38b42184055', '74d5607a-bfaf-42b0-b7b0-f4504cb8c658', '9005cdc5-ac87-4dd9-aa21-e7228eed6fe4'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:07 devstack sudo[87263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:06:07 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:07 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:07 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:07 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:07 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:08 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.560s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3296a10-d7e3-43cf-b881-ce99920e93c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07447b7e-138c-4c1e-8899-4e9d917a44cc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:08 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (a51ea040-41ab-4b83-93bf-9be4061aa23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580ff2f6-02d0-40ea-b6bd-bbf79d99738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.484s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.manager [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:08 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580ff2f6-02d0-40ea-b6bd-bbf79d99738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1194003481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19b4bac-0159-4afc-a2eb-cb71eb25d3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:08Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9cb56-10da-49d6-b41a-84c3c5f2ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9cb56-10da-49d6-b41a-84c3c5f2ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29371f-121e-4d1f-8d71-956d89f879ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b29371f-121e-4d1f-8d71-956d89f879ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19b4bac-0159-4afc-a2eb-cb71eb25d3d6', 'volume_name': 'volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5ebd0-0ac1-4479-a8b9-bea1f33c6b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5ebd0-0ac1-4479-a8b9-bea1f33c6b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1067b882-914f-4f0f-bfd0-3975b66936bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:08 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume d19b4bac-0159-4afc-a2eb-cb71eb25d3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6', 'volume_size': 1}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1194003481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19b4bac-0159-4afc-a2eb-cb71eb25d3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:08Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating volume d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:08 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:08 devstack sudo[87274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:06:08 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Deleted volume successfully.
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.652s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Deleted volume successfully.
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [req-c0518254-2a94-40e5-9c22-6677f6810767 req-2f4c019f-74df-4255-8062-5cea81fbe8ff tempest-ServerBootFromVolumeStableRescueTest-496905417 None] Lock "cinder-62c46152-507c-400c-9c3a-daf3614913e0-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:08 devstack sudo[87275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 1073741824
Apr 08 11:06:08 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-56237bc5-1fd1-4b5f-ae61-7efd73fb3749 tempest-VolumesSnapshotListTestJSON-836957919 None] Lock "cinder-a54a90fc-5aee-43e7-9e42-702ea669f065-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:08 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.603s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:08 devstack sudo[87284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:06:08 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:08 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 1073741824" returned: 0 in 0.588s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:08 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6
Apr 08 11:06:08 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:09 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.570s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:09 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:09 devstack sudo[87292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df
Apr 08 11:06:09 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1067b882-914f-4f0f-bfd0-3975b66936bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d94776-9512-4837-b634-f49cc8052bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:09 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 (d19b4bac-0159-4afc-a2eb-cb71eb25d3d6): created successfully
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d94776-9512-4837-b634-f49cc8052bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (a51ea040-41ab-4b83-93bf-9be4061aa23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ea4e8b25-bb77-4b8a-b1ba-5ccd63816854 tempest-VolumesSnapshotTestJSON-1063214283 None] Created volume successfully.
Apr 08 11:06:09 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.66bf351c-4646-4be2-85a5-d10eebf3d3df" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 -F qcow2 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:09 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 -F qcow2
Apr 08 11:06:09 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (74f60251-aafd-45b2-9fec-3ccab0c95129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1967c-b5ad-488c-9a5d-1d164ee2ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f1967c-b5ad-488c-9a5d-1d164ee2ff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654713964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104c2b57-5a8c-43f8-b36c-54c6ac7a2322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:10Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cbe47f-c0c7-4a6c-b66e-38a9c404e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cbe47f-c0c7-4a6c-b66e-38a9c404e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aee1e3-e144-4429-a8b2-774ec3ca5150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aee1e3-e144-4429-a8b2-774ec3ca5150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104c2b57-5a8c-43f8-b36c-54c6ac7a2322', 'volume_name': 'volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd241556-a7a3-4a7b-81ac-644ca84ccb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd241556-a7a3-4a7b-81ac-644ca84ccb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ab0d51-6602-4e08-b5c5-9f6df3c4fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:10 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 104c2b57-5a8c-43f8-b36c-54c6ac7a2322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322', 'volume_size': 1}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-654713964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104c2b57-5a8c-43f8-b36c-54c6ac7a2322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:10Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:10 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:10 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 1073741824
Apr 08 11:06:10 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:10 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 -F qcow2" returned: 0 in 0.536s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-66bf351c-4646-4be2-85a5-d10eebf3d3df" released by "_delete_snapshot" :: held 4.822s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" released by "delete_snapshot" :: held 4.831s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['ef33f857-f274-4a60-b3d6-95f57ccac2b6', '985bb85b-a430-433d-8609-efb61e770419', 'd8e57561-ac2a-4bef-8e83-a468a8925ae8', '9bcaff1b-738c-4a91-9f4e-9f65ec32179a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Delete snapshot completed successfully.
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-66bf351c-4646-4be2-85a5-d10eebf3d3df-delete_snapshot" released by "delete_snapshot" :: held 4.921s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-d08daf91-6d74-45c0-b97c-cc41e02d7246-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-d08daf91-6d74-45c0-b97c-cc41e02d7246-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-d08daf91-6d74-45c0-b97c-cc41e02d7246" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d08daf91-6d74-45c0-b97c-cc41e02d7246" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Deleting offline snapshot d08daf91-6d74-45c0-b97c-cc41e02d7246 of volume f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] snapshot_file for this snap is: volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626a885-dfea-4978-bddf-f51abf3a9318]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:10 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:10 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:10 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 1073741824" returned: 0 in 0.546s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:10 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322
Apr 08 11:06:10 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:11 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.576s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3296a10-d7e3-43cf-b881-ce99920e93c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a969cc1f-58f1-471e-8493-e3a5586084f5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:11 devstack sudo[87343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:06:11 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:11 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.667s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ab0d51-6602-4e08-b5c5-9f6df3c4fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c45f70-1b52-44b4-acb6-8a5f27e8e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating offline snapshot cdb65cef-3ec7-4a7e-9561-cd966e676b73 of volume d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d34ea-91fd-43af-b6f7-f728f59dd053]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:11 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 (104c2b57-5a8c-43f8-b36c-54c6ac7a2322): created successfully
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32c45f70-1b52-44b4-acb6-8a5f27e8e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (74f60251-aafd-45b2-9fec-3ccab0c95129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:11 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b873193c-1357-42af-b6f6-994390ea4ee0 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:11 devstack sudo[87346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6
Apr 08 11:06:11 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:11 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.524s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:11 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:11 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:11 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:11 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 1G
Apr 08 11:06:11 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:12 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:12 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246
Apr 08 11:06:12 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:12 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 1G" returned: 0 in 0.538s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:12 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73
Apr 08 11:06:12 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:12 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3.d08daf91-6d74-45c0-b97c-cc41e02d7246" returned: 0 in 0.553s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d08daf91-6d74-45c0-b97c-cc41e02d7246" released by "_delete_snapshot" :: held 2.186s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" released by "delete_snapshot" :: held 2.196s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['296e3dbe-7471-403d-9d09-16d4047a673d', '4483e0c3-1c56-41ff-8bfe-d8c4703b3a0b', 'b870ff6f-ba6d-4ade-b649-d66065e0a0c3', '5b2159b6-25ae-434b-a969-688fb6729fbd'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Delete snapshot completed successfully.
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-d08daf91-6d74-45c0-b97c-cc41e02d7246-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Snapshots deleted, issuing volume delete {{(pid=82670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3cf768-8f1a-4e63-9bc3-12a76c9a82ee]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:12 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73" returned: 0 in 0.543s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:12 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 is being set with open permissions: ugo+rw
Apr 08 11:06:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:12 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:06:12 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:12 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73
Apr 08 11:06:12 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:13 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73" returned: 0 in 0.427s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:13 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.499s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:13 devstack sudo[87386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3
Apr 08 11:06:13 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:13 devstack sudo[87388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info
Apr 08 11:06:13 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:13 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f3296a10-d7e3-43cf-b881-ce99920e93c3" returned: 0 in 0.416s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-f3296a10-d7e3-43cf-b881-ce99920e93c3" released by "delete_volume" :: held 0.941s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['7bd4a2a9-b28c-448f-ab6f-bf95209104e7', '453650a0-bf18-4a89-99d5-1a4d37f59991', '2d799450-b288-44e3-ac82-c9f6f6c959c4', '1e76e9b0-8373-4b56-a9ce-da66f85c127e'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:13 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info" returned: 0 in 0.459s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:13 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info is being set with open permissions: ugo+rw
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:13 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info
Apr 08 11:06:13 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:13 devstack sudo[87394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:13 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:14 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.410s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Deleted volume successfully.
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a615ec8e-2169-4d11-aef8-e9bbe29beeb8 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-f3296a10-d7e3-43cf-b881-ce99920e93c3-delete_volume" released by "delete_volume" :: held 8.754s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:14 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.info" returned: 0 in 0.480s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.021s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.895s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating offline snapshot 65c8265d-1b4c-4f4b-92bc-7a6c868886b5 of volume 104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0180470b-9b78-4c6f-a4b2-8772f266af74]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e827438c-505a-49cb-8dfb-ad1afdd2b6f1 tempest-VolumesSnapshotTestJSON-1063214283 None] Create snapshot completed successfully
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (1e0409a1-451d-4f97-b987-34673e9ceb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5298c0fc-f4bb-41d3-8ad5-2d4683759c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:14 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322
Apr 08 11:06:14 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5298c0fc-f4bb-41d3-8ad5-2d4683759c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-811331662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d034d38-f2e3-41a2-8414-0fe14ed4e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760b301bdeb487f8dc8228cc4763be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:14Z,use_quota=True,user_id='f4a0928fa623476eb28c8febf206af15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29bb610-fecf-4de7-8eab-ebe64c9532be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29bb610-fecf-4de7-8eab-ebe64c9532be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb764811-0823-49bd-95bc-aad0fee1dfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb764811-0823-49bd-95bc-aad0fee1dfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d034d38-f2e3-41a2-8414-0fe14ed4e024', 'volume_name': 'volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f276338a-f98a-43a1-ac3e-ed0764249632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f276338a-f98a-43a1-ac3e-ed0764249632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adf8eb9-fba2-435d-bb0e-1f9a91ca353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:14 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Volume 3d034d38-f2e3-41a2-8414-0fe14ed4e024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024', 'volume_size': 1}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-cdb65cef-3ec7-4a7e-9561-cd966e676b73-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-cdb65cef-3ec7-4a7e-9561-cd966e676b73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-cdb65cef-3ec7-4a7e-9561-cd966e676b73" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-cdb65cef-3ec7-4a7e-9561-cd966e676b73" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Deleting offline snapshot cdb65cef-3ec7-4a7e-9561-cd966e676b73 of volume d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] snapshot_file for this snap is: volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e754c720-04e5-4c2a-a0d4-d0fa6814f18b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:14 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" returned: 0 in 0.516s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:14 devstack sudo[87404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 1G
Apr 08 11:06:14 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:14 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73
Apr 08 11:06:14 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:15 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73" returned: 0 in 0.492s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0d5b0a-cd2f-46e5-b65a-7f78442a2b65]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:15 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 1G" returned: 0 in 0.524s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:15 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5
Apr 08 11:06:15 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:15 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6
Apr 08 11:06:15 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:15 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5" returned: 0 in 0.446s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:15 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 is being set with open permissions: ugo+rw
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:15 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" returned: 0 in 0.498s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:15 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5
Apr 08 11:06:15 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:15 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73
Apr 08 11:06:15 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:16 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5" returned: 0 in 0.428s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:16 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info
Apr 08 11:06:16 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:16 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73" returned: 0 in 0.519s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:16 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73
Apr 08 11:06:16 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:16 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info" returned: 0 in 0.465s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:16 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info is being set with open permissions: ugo+rw
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:16 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info
Apr 08 11:06:16 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:16 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6.cdb65cef-3ec7-4a7e-9561-cd966e676b73" returned: 0 in 0.419s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-cdb65cef-3ec7-4a7e-9561-cd966e676b73" released by "_delete_snapshot" :: held 1.986s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" released by "delete_snapshot" :: held 1.998s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['1e35312a-07f1-47c6-a565-415952b76f51', 'c16e6576-1291-4740-86e8-7f45aed8eeef', '36c39ce1-7032-4a62-9149-0af9a51a9d49', '04dcca01-7473-4dc6-a619-221cc56467dc'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Delete snapshot completed successfully.
Apr 08 11:06:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-52ac1335-cad4-473a-a8bd-006574b89290 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-cdb65cef-3ec7-4a7e-9561-cd966e676b73-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:17 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.info" returned: 0 in 0.448s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.982s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.782s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-811331662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d034d38-f2e3-41a2-8414-0fe14ed4e024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760b301bdeb487f8dc8228cc4763be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:14Z,use_quota=True,user_id='f4a0928fa623476eb28c8febf206af15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Creating volume 3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:17 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:17 devstack sudo[87441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 1073741824
Apr 08 11:06:17 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-cb49d5b5-5316-4857-ae10-c0017f77cf2b tempest-CreateVolumesFromSnapshotTest-474266758 None] Create snapshot completed successfully
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (07c76eb7-9426-4a31-a7d8-1c93b961250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c202ce3-91c6-4c13-8ce7-9e306c9f9033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c202ce3-91c6-4c13-8ce7-9e306c9f9033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175667814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232d12ea-de38-446a-839a-95b646f6987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232d12ea-de38-446a-839a-95b646f6987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2e5ecf-43a7-421d-bb4d-14bdbd2f115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2e5ecf-43a7-421d-bb4d-14bdbd2f115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d', 'volume_name': 'volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bf9cf4-2d30-4496-bff1-d6d2403d192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bf9cf4-2d30-4496-bff1-d6d2403d192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e194da71-7989-4245-89b2-50ce49f2330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:17 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d', 'volume_size': 1}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:17 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 1073741824" returned: 0 in 0.655s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:17 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:17 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (2108bf19-0d56-4b75-aed5-0be45bcf8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a471bdb-0618-4fde-8031-a3f8821bcd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a471bdb-0618-4fde-8031-a3f8821bcd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509189929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be69b9c-47e8-493a-9978-df666572aaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be87816b-4e56-48bd-b91b-84a640afe5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be87816b-4e56-48bd-b91b-84a640afe5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea721d17-bd43-4d8b-84dc-dbb68ff0fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea721d17-bd43-4d8b-84dc-dbb68ff0fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0be69b9c-47e8-493a-9978-df666572aaef', 'volume_name': 'volume-0be69b9c-47e8-493a-9978-df666572aaef', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe8272-70ee-4b8e-ac54-4ff189f6897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fe8272-70ee-4b8e-ac54-4ff189f6897b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656c5dfd-5409-4300-a772-d551b3950776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 0be69b9c-47e8-493a-9978-df666572aaef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0be69b9c-47e8-493a-9978-df666572aaef', 'volume_size': 1}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (397da8e7-d8a8-4555-bd4a-b255c3af4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82592591-6c31-411b-bb50-01cd9c2c3768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82592591-6c31-411b-bb50-01cd9c2c3768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110980897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47166f23-7d42-428d-b54d-552235e9beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d8a52-b61f-4b64-b106-f16d6500a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d8a52-b61f-4b64-b106-f16d6500a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4364c368-0c2b-4d1b-94af-6a98a451ea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4364c368-0c2b-4d1b-94af-6a98a451ea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47166f23-7d42-428d-b54d-552235e9beab', 'volume_name': 'volume-47166f23-7d42-428d-b54d-552235e9beab', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f913e67-7c1d-4baf-bbb8-e539177a68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f913e67-7c1d-4baf-bbb8-e539177a68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd08b4-2b70-471f-8fec-88432d898024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 47166f23-7d42-428d-b54d-552235e9beab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47166f23-7d42-428d-b54d-552235e9beab', 'volume_size': 1}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (a3a569de-7dd7-4f0d-aee5-3f310f065f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84054b2f-f1df-4844-9c83-726a6a205f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84054b2f-f1df-4844-9c83-726a6a205f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1852001260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c603c8-6f11-4bfc-bded-7f02a68437ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49be97b5-574f-4526-82d6-ddcf848e86a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49be97b5-574f-4526-82d6-ddcf848e86a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d314b3e9-dc8f-4933-ad93-b2af4c10aa6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d314b3e9-dc8f-4933-ad93-b2af4c10aa6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c603c8-6f11-4bfc-bded-7f02a68437ed', 'volume_name': 'volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd0ddaa-7e5f-40a3-8746-fb6e366d2772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd0ddaa-7e5f-40a3-8746-fb6e366d2772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a2f816-c84d-48ba-bf86-e43b32a8d20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume a2c603c8-6f11-4bfc-bded-7f02a68437ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed', 'volume_size': 1}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.601s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1175667814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adf8eb9-fba2-435d-bb0e-1f9a91ca353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee84e1c4-0636-4b5f-94d3-843ec5ea603f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d 1073741824
Apr 08 11:06:18 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (7a02e714-9298-47b0-b64d-b43979861f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747dec89-977f-4e52-8cbf-c1703376440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747dec89-977f-4e52-8cbf-c1703376440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243715658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7721c76e-4a63-48dc-94d2-80612ae7e324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dd657b-a547-4611-9372-34979d1e9329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14dd657b-a547-4611-9372-34979d1e9329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69633676-6b4f-4ffe-8866-dc3bed6e46db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69633676-6b4f-4ffe-8866-dc3bed6e46db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7721c76e-4a63-48dc-94d2-80612ae7e324', 'volume_name': 'volume-7721c76e-4a63-48dc-94d2-80612ae7e324', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb77a2f-803b-45c0-bd8d-ed60d332b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb77a2f-803b-45c0-bd8d-ed60d332b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9da7202-a7b1-468f-afaa-452da1b406d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 7721c76e-4a63-48dc-94d2-80612ae7e324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7721c76e-4a63-48dc-94d2-80612ae7e324', 'volume_size': 1}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Volume volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 (3d034d38-f2e3-41a2-8414-0fe14ed4e024): created successfully
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee84e1c4-0636-4b5f-94d3-843ec5ea603f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (1e0409a1-451d-4f97-b987-34673e9ceb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3f866f9a-b2e3-4a33-b0f9-eaa36280c8b1 tempest-VolumesDeleteCascade-1804139365 None] Created volume successfully.
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (ab81acf7-6224-447f-a622-8510067eea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b3ff3f-ebce-4494-b7e3-e5edb89a7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b3ff3f-ebce-4494-b7e3-e5edb89a7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730699441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1c89a-5505-43c8-bb22-db53694abc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:19Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b72f63-2757-4cdc-86b5-474b2b06b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b72f63-2757-4cdc-86b5-474b2b06b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0fa3cf-2001-4b40-891e-f68f3acd62b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0fa3cf-2001-4b40-891e-f68f3acd62b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd1c89a-5505-43c8-bb22-db53694abc2a', 'volume_name': 'volume-6bd1c89a-5505-43c8-bb22-db53694abc2a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d44eaa-a9a3-4131-a884-ff3ffe9879e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d44eaa-a9a3-4131-a884-ff3ffe9879e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87f9f30-d92c-4105-b114-6bfe8bc1b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume 6bd1c89a-5505-43c8-bb22-db53694abc2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd1c89a-5505-43c8-bb22-db53694abc2a', 'volume_size': 1}
Apr 08 11:06:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:19 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d 1073741824" returned: 0 in 0.586s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:19 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d
Apr 08 11:06:19 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:19 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.476s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-509189929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be69b9c-47e8-493a-9978-df666572aaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 0be69b9c-47e8-493a-9978-df666572aaef {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:19 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e194da71-7989-4245-89b2-50ce49f2330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c409e7bb-c01b-42c0-a992-476081864ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:19 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef 1073741824
Apr 08 11:06:19 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:19 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d (6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d): created successfully
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c409e7bb-c01b-42c0-a992-476081864ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (07c76eb7-9426-4a31-a7d8-1c93b961250a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:19 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-754d567e-37b0-47c4-913e-92feedf743a7 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:20 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef 1073741824" returned: 0 in 0.596s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:20 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef
Apr 08 11:06:20 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:20 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef" returned: 0 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.278s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110980897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47166f23-7d42-428d-b54d-552235e9beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 47166f23-7d42-428d-b54d-552235e9beab {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:20 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656c5dfd-5409-4300-a772-d551b3950776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be69b9c-47e8-493a-9978-df666572aaef', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f36904b-bfa1-4386-a000-129bd58132e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:20 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab 1073741824
Apr 08 11:06:20 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-0be69b9c-47e8-493a-9978-df666572aaef (0be69b9c-47e8-493a-9978-df666572aaef): created successfully
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f36904b-bfa1-4386-a000-129bd58132e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (2108bf19-0d56-4b75-aed5-0be45bcf8232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-56832ff2-5c8c-41e9-a321-da0454a7b410 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:21 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab 1073741824" returned: 0 in 0.514s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:21 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab
Apr 08 11:06:21 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:21 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1852001260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c603c8-6f11-4bfc-bded-7f02a68437ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Creating volume a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:21 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd08b4-2b70-471f-8fec-88432d898024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47166f23-7d42-428d-b54d-552235e9beab', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:21 devstack sudo[87476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed 1073741824
Apr 08 11:06:21 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941ac3f0-b2b8-42f3-986c-8b63a75be1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-47166f23-7d42-428d-b54d-552235e9beab (47166f23-7d42-428d-b54d-552235e9beab): created successfully
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941ac3f0-b2b8-42f3-986c-8b63a75be1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (397da8e7-d8a8-4555-bd4a-b255c3af4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8da4194c-b840-4ad5-9e57-120e500618a5 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:22 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed 1073741824" returned: 0 in 0.534s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:22 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:22 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:22 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-243715658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7721c76e-4a63-48dc-94d2-80612ae7e324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:18Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 7721c76e-4a63-48dc-94d2-80612ae7e324 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:22 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a2f816-c84d-48ba-bf86-e43b32a8d20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:22 devstack sudo[87484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 1073741824
Apr 08 11:06:22 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd44057-b8bb-4a3b-b94b-063778b67453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:22 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed (a2c603c8-6f11-4bfc-bded-7f02a68437ed): created successfully
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd44057-b8bb-4a3b-b94b-063778b67453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (a3a569de-7dd7-4f0d-aee5-3f310f065f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:22 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-59b4b5cd-541c-426a-aedc-04380f057afd tempest-VolumesSnapshotTestJSON-1063214283 None] Created volume successfully.
Apr 08 11:06:23 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 1073741824" returned: 0 in 0.584s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:23 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324
Apr 08 11:06:23 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:23 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.934s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1730699441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1c89a-5505-43c8-bb22-db53694abc2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca3f131f5d934686a3fe06ae02a1cc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:19Z,use_quota=True,user_id='771c197d3ab3496e9a91558f68c9557e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Creating volume 6bd1c89a-5505-43c8-bb22-db53694abc2a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:23 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9da7202-a7b1-468f-afaa-452da1b406d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7721c76e-4a63-48dc-94d2-80612ae7e324', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd733158-9bc3-4d75-bff3-d750e04958ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:23 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a 1073741824
Apr 08 11:06:23 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:23 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-7721c76e-4a63-48dc-94d2-80612ae7e324 (7721c76e-4a63-48dc-94d2-80612ae7e324): created successfully
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd733158-9bc3-4d75-bff3-d750e04958ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:23 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (7a02e714-9298-47b0-b64d-b43979861f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-470afd27-977f-4852-9ded-9fdfd1f79bae tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:24 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a 1073741824" returned: 0 in 0.630s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:24 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a
Apr 08 11:06:24 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:24 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a" returned: 0 in 0.484s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.122s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87f9f30-d92c-4105-b114-6bfe8bc1b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd1c89a-5505-43c8-bb22-db53694abc2a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904b521-e26e-472a-b70e-a1b8fab2258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Creating offline snapshot ad93fc66-2158-4329-b062-88e78a4b3478 of volume 3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:24 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Volume volume-6bd1c89a-5505-43c8-bb22-db53694abc2a (6bd1c89a-5505-43c8-bb22-db53694abc2a): created successfully
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904b521-e26e-472a-b70e-a1b8fab2258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Flow 'volume_create_manager' (ab81acf7-6224-447f-a622-8510067eea49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e2e31-0f25-41a3-8800-a033c6c152cd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ef9fe756-8ddb-4bb3-b0fc-b3ccff848ebd tempest-CreateVolumesFromSnapshotTest-474266758 None] Created volume successfully.
Apr 08 11:06:25 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:25 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-6bd1c89a-5505-43c8-bb22-db53694abc2a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-6bd1c89a-5505-43c8-bb22-db53694abc2a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-6bd1c89a-5505-43c8-bb22-db53694abc2a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-6bd1c89a-5505-43c8-bb22-db53694abc2a" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[00292b91-8801-4d69-a026-d76115417651]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:25 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a
Apr 08 11:06:25 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:25 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.652s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:25 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 1G
Apr 08 11:06:25 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:26 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a" returned: 0 in 0.637s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:26 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a
Apr 08 11:06:26 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:26 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 1G" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:26 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:26 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:26 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6bd1c89a-5505-43c8-bb22-db53694abc2a" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-6bd1c89a-5505-43c8-bb22-db53694abc2a" released by "delete_volume" :: held 1.198s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['1c2b5bc5-80a2-46e4-8116-fddbd4b4216f', '2a1f9379-f2a5-4a49-978d-63c2443e6156', 'd4246278-7760-42b4-9c2f-f1e4c8d5f2f4', '7295453d-5357-40e2-aab7-7eb3104ababc'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:26 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:26 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 is being set with open permissions: ugo+rw
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:26 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:26 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:26 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:26 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:27 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 0.551s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:27 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info
Apr 08 11:06:27 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:27 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6bd49de8-f3a5-46d8-9451-dd05aebfd524 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-6bd1c89a-5505-43c8-bb22-db53694abc2a-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-7721c76e-4a63-48dc-94d2-80612ae7e324-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-7721c76e-4a63-48dc-94d2-80612ae7e324-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-7721c76e-4a63-48dc-94d2-80612ae7e324" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-7721c76e-4a63-48dc-94d2-80612ae7e324" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[688c7cb6-d002-4711-b322-d99e48c93b09]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:27 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info" returned: 0 in 0.416s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:27 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info is being set with open permissions: ugo+rw
Apr 08 11:06:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:27 devstack sudo[87542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info
Apr 08 11:06:27 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:27 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324
Apr 08 11:06:27 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:28 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.info" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.217s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.442s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating offline snapshot 7c559204-cc91-44e7-8665-4d0e3e616bcd of volume a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-43388080-5833-4496-aab1-b75c7fd36743 tempest-VolumesDeleteCascade-1804139365 None] Create snapshot completed successfully
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f75870-0f60-4613-a6b8-2cf5f2fb50dd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:28 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324" returned: 0 in 0.526s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:28 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324
Apr 08 11:06:28 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:28 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:28 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:28 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-7721c76e-4a63-48dc-94d2-80612ae7e324" returned: 0 in 0.435s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-7721c76e-4a63-48dc-94d2-80612ae7e324" released by "delete_volume" :: held 0.985s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['2a28758e-dc8b-4e90-ae05-d44ffca56923', '65ce09f2-5775-471f-bdfa-8c03ec15cb2c', 'd6b6e02f-9b74-4928-a11e-264401b23ae9', '4388b12e-3453-403b-9ed3-8f57ef702e19'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:28 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.499s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:28 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd 1G
Apr 08 11:06:28 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:28 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:28 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-47166f23-7d42-428d-b54d-552235e9beab-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-47166f23-7d42-428d-b54d-552235e9beab-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-47166f23-7d42-428d-b54d-552235e9beab" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-47166f23-7d42-428d-b54d-552235e9beab" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02896ae-2c38-4303-8de0-8ec36468daf8]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:28 devstack sudo[87562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab
Apr 08 11:06:28 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:29 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.437s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:29 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c1cc61a4-2967-4722-a2cb-a28ccd7a0e79 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-7721c76e-4a63-48dc-94d2-80612ae7e324-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:29 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd 1G" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:29 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:29 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:29 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab" returned: 0 in 0.582s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:29 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab
Apr 08 11:06:29 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (ac417227-c12b-4175-8f6c-a1c97d2fe592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2eb0b5-9fae-41c2-9447-9c9aef3b81a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2eb0b5-9fae-41c2-9447-9c9aef3b81a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2033356279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35cb2b1-d34b-477d-91a7-7bae94f107f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760b301bdeb487f8dc8228cc4763be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad93fc66-2158-4329-b062-88e78a4b3478,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:29Z,use_quota=True,user_id='f4a0928fa623476eb28c8febf206af15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd71b79-a090-4b84-bedb-e346c8558a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd71b79-a090-4b84-bedb-e346c8558a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecf7663-2c0f-41ac-b130-9072f218731f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecf7663-2c0f-41ac-b130-9072f218731f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd35cb2b1-d34b-477d-91a7-7bae94f107f3', 'volume_name': 'volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3', 'volume_size': 1, 'snapshot_id': 'ad93fc66-2158-4329-b062-88e78a4b3478'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177b6796-3333-453b-9e57-c95e382d4be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177b6796-3333-453b-9e57-c95e382d4be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d5cb38-e1c3-4b86-8f6f-c77f3d5cf9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:29 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Volume d35cb2b1-d34b-477d-91a7-7bae94f107f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3', 'volume_size': 1, 'snapshot_id': 'ad93fc66-2158-4329-b062-88e78a4b3478'}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:29 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.501s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:29 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd is being set with open permissions: ugo+rw
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:29 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:29 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:29 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-47166f23-7d42-428d-b54d-552235e9beab" returned: 0 in 0.421s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-47166f23-7d42-428d-b54d-552235e9beab" released by "delete_volume" :: held 1.028s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['6fd05a95-de31-4cf4-b851-d24ac7de96a6', '9729357e-c694-4371-97c6-55c0d6a9f033', 'd22f8890-ecce-4cb5-b3db-e1d3f33dfa1d', '10516199-3dbd-4f43-a580-b061b865a796'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:29 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:29 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:30 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.436s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:30 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info
Apr 08 11:06:30 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:30 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.426s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1599aab2-c03c-40ee-b0e7-beb90058731c tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-47166f23-7d42-428d-b54d-552235e9beab-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:30 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:30 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info is being set with open permissions: ugo+rw
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:30 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info
Apr 08 11:06:30 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-0be69b9c-47e8-493a-9978-df666572aaef-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-0be69b9c-47e8-493a-9978-df666572aaef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-0be69b9c-47e8-493a-9978-df666572aaef" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-0be69b9c-47e8-493a-9978-df666572aaef" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be83637-70e1-43c4-9a8f-add804b234aa]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:31 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.info" returned: 0 in 0.456s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:31 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef
Apr 08 11:06:31 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.537s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478-d35cb2b1-d34b-477d-91a7-7bae94f107f3" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478-d35cb2b1-d34b-477d-91a7-7bae94f107f3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Creating volume d35cb2b1-d34b-477d-91a7-7bae94f107f3 from snapshot ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2a79c411-5489-4f08-ba90-f4c174a6e606 tempest-VolumesSnapshotTestJSON-1063214283 None] Create snapshot completed successfully
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] snapshot: ad93fc66-2158-4329-b062-88e78a4b3478, volume: d35cb2b1-d34b-477d-91a7-7bae94f107f3,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd0ba1b-fb08-4a90-9fbd-cf607eb4aa9e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:31 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:31 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:31 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef" returned: 0 in 0.574s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:31 devstack sudo[87605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef
Apr 08 11:06:31 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:31 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 0.616s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29cf2ca-fa7f-4130-b563-d30b0c362dab]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:31 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:31 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:32 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0be69b9c-47e8-493a-9978-df666572aaef" returned: 0 in 0.553s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-0be69b9c-47e8-493a-9978-df666572aaef" released by "delete_volume" :: held 1.152s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['bbd40f18-7e13-4d87-abf4-718f465aecdf', '5c0d497d-3396-4a6f-b809-80f014428d15', 'fd0a95f7-7bd7-4eb0-bd8c-ef78887e1484', 'f6555065-c619-4c88-962d-c97be13ed21f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:32 devstack sudo[87613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:32 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:32 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (da2ff8ca-d8cc-441f-a8cb-f332bc6074b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd4704c-7b78-4817-aaec-32fb4052f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.651s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:32 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3
Apr 08 11:06:32 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd4704c-7b78-4817-aaec-32fb4052f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1211601922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7c559204-cc91-44e7-8665-4d0e3e616bcd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:32Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddf4f37-0253-46b9-944d-810317fb20bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddf4f37-0253-46b9-944d-810317fb20bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb29937-bbc8-461f-9f36-41838569637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb29937-bbc8-461f-9f36-41838569637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf', 'volume_name': 'volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf', 'volume_size': 2, 'snapshot_id': '7c559204-cc91-44e7-8665-4d0e3e616bcd'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe047d-b7cc-4b0e-a805-fa542aeb27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe047d-b7cc-4b0e-a805-fa542aeb27b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b450d0e9-60a0-4850-9947-8801b957faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume 9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf', 'volume_size': 2, 'snapshot_id': '7c559204-cc91-44e7-8665-4d0e3e616bcd'}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:32 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.510s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-559dd16e-16b1-4915-b116-d218af0c50df tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-0be69b9c-47e8-493a-9978-df666572aaef-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=188,cinder:UPDATE=206,cinder:DELETE=22,cinder:INSERT=59 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" acquired by "delete_volume" :: waited 0.047s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4487984e-337b-4fa7-b357-600fcde0e385]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:33 devstack sudo[87644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d
Apr 08 11:06:33 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:34 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" returned: 0 in 1.340s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:34 devstack sudo[87655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d
Apr 08 11:06:34 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:35 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3" returned: 0 in 2.670s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd149cc0-0b11-49d9-9c9b-fdd481eb335a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:35 devstack sudo[87658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:35 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:35 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" returned: 0 in 0.635s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d" released by "delete_volume" :: held 2.035s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:UPDATE=257,cinder:SELECT=190,cinder:INSERT=55,cinder:DELETE=21 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['96a162cb-8bce-484a-9f77-87b0d5ffc7f1', 'e329d648-abe0-4e92-abce-6764c83b7a32', '7b11ce46-3d62-4324-afcc-612e6e9df2b6', '299f9632-50b4-4693-a6e1-330baf4b7705'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:35 devstack sudo[87676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:35 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-65c8265d-1b4c-4f4b-92bc-7a6c868886b5-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-65c8265d-1b4c-4f4b-92bc-7a6c868886b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-65c8265d-1b4c-4f4b-92bc-7a6c868886b5" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-65c8265d-1b4c-4f4b-92bc-7a6c868886b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleting offline snapshot 65c8265d-1b4c-4f4b-92bc-7a6c868886b5 of volume 104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] snapshot_file for this snap is: volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df83eb5-8e76-4876-aa92-133185d2f4c7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:35 devstack sudo[87679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5
Apr 08 11:06:35 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:36 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.850s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024, size 1024.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:06:36 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Converted 1024.00 MB image at 383.33 MB/s
Apr 08 11:06:36 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 is being set with open permissions: ugo+rw
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:36 devstack sudo[87683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3
Apr 08 11:06:36 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:36 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b2857a34-5861-4fae-96e4-10a47d039675 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-6105b1fc-b4d9-40cc-b41a-3eb4d14e1e3d-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:36 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3301ee-2a11-4827-941e-067888a63e5c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:36 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" released by "_copy_volume_from_snapshot" :: held 5.345s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478-d35cb2b1-d34b-477d-91a7-7bae94f107f3" released by "_create_volume_from_snapshot" :: held 5.367s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.394s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.956s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:36 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322
Apr 08 11:06:36 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating volume 9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf from snapshot 7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d5cb38-e1c3-4b86-8f6f-c77f3d5cf9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3', 'volume_size': 1, 'snapshot_id': 'ad93fc66-2158-4329-b062-88e78a4b3478'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675ff14f-821a-4aad-a4f4-f4a239f36062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] snapshot: 7c559204-cc91-44e7-8665-4d0e3e616bcd, volume: 9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:36 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Volume volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 (d35cb2b1-d34b-477d-91a7-7bae94f107f3): created successfully
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675ff14f-821a-4aad-a4f4-f4a239f36062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Flow 'volume_create_manager' (ac417227-c12b-4175-8f6c-a1c97d2fe592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0249531e-b9fe-462a-9cc1-25dd09aeaba4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-55351b75-34e5-41cd-99b3-b26ef443a4ca tempest-VolumesDeleteCascade-1804139365 None] Created volume successfully.
Apr 08 11:06:36 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:36 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:36 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" returned: 0 in 0.497s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:36 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5
Apr 08 11:06:36 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-3d034d38-f2e3-41a2-8414-0fe14ed4e024-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-3d034d38-f2e3-41a2-8414-0fe14ed4e024-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Performing cascade delete. {{(pid=82670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-ad93fc66-2158-4329-b062-88e78a4b3478-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-ad93fc66-2158-4329-b062-88e78a4b3478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Deleting offline snapshot ad93fc66-2158-4329-b062-88e78a4b3478 of volume 3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] snapshot_file for this snap is: volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[811353fe-eaa1-41cc-a943-69249c5e2017]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:37 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.591s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88d037-b4a9-4db9-b041-7531176273d9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:37 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:37 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:37 devstack sudo[87708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:37 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:37 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:37 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5
Apr 08 11:06:37 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:37 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 0.567s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eebb56b-61ee-4749-aac1-ccb239e00ce9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:38 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322.65c8265d-1b4c-4f4b-92bc-7a6c868886b5" returned: 0 in 0.561s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:38 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:38 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-65c8265d-1b4c-4f4b-92bc-7a6c868886b5" released by "_delete_snapshot" :: held 2.185s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" released by "delete_snapshot" :: held 2.207s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:38 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.866s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['a3a5d94d-71d0-46ae-ac8e-324312dc6c99', 'fa1e7b8e-c83b-4dbd-947b-7282e34ea9ad', '84d1a142-bf04-4c6b-aabb-3d3dd3604f94', '212ec34c-9f27-44bc-a596-3c2864582ef2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:38 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf
Apr 08 11:06:38 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Delete snapshot completed successfully.
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c08aae01-dffb-49d3-a29c-44c4da58746e tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-65c8265d-1b4c-4f4b-92bc-7a6c868886b5-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:38 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.927s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:38 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:38 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-104c2b57-5a8c-43f8-b36c-54c6ac7a2322-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-104c2b57-5a8c-43f8-b36c-54c6ac7a2322-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[042300a6-479a-4241-9372-02a38343cd1a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:39 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 0.988s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:39 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478
Apr 08 11:06:39 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:40 devstack sudo[87808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322
Apr 08 11:06:40 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:41 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" returned: 0 in 3.303s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c32d08-fba0-484b-989c-12ff115ebf1d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:41 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024.ad93fc66-2158-4329-b062-88e78a4b3478" returned: 0 in 1.772s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-ad93fc66-2158-4329-b062-88e78a4b3478" released by "_delete_snapshot" :: held 4.366s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" released by "delete_snapshot" :: held 4.378s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['7615b291-fa35-4765-b8b5-9a41e63c85be', '298f4563-7458-48b0-9951-1d7f180a3688', '5f812275-cba3-404d-95fa-cf16aff594e5', '87b153a4-b27a-4895-9c38-8dd1a569e17b'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:41 devstack sudo[87843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:41 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Delete snapshot completed successfully.
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-ad93fc66-2158-4329-b062-88e78a4b3478-delete_snapshot" released by "delete_snapshot" :: held 4.602s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Snapshots deleted, issuing volume delete {{(pid=82670) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:41 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" returned: 0 in 2.207s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1f200-9689-4591-a125-baa001da2dfc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:41 devstack sudo[87847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322
Apr 08 11:06:41 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:41 devstack sudo[87848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:41 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:42 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.519s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:42 devstack sudo[87858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024
Apr 08 11:06:42 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:42 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" returned: 0 in 0.576s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-quobyte-104c2b57-5a8c-43f8-b36c-54c6ac7a2322" released by "delete_volume" :: held 2.871s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Created reservations ['6c9e13b7-43a6-43dc-9562-f6d877d527c7', '02bc50d4-dc01-4faf-b85b-5f825a369942', 'fb9e8422-c2cb-4547-ad3f-b3570d6a7355', '66f0afa6-cfbf-4281-a40b-379d9e7656ab'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:42 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:42 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:42 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 1.024s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed, size 1024.00 MB, duration 3.30 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:06:42 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Converted 1024.00 MB image at 309.89 MB/s
Apr 08 11:06:42 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf is being set with open permissions: ugo+rw
Apr 08 11:06:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:42 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf
Apr 08 11:06:42 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:43 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.665s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:43 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Deleted volume successfully.
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3d034d38-f2e3-41a2-8414-0fe14ed4e024" returned: 0 in 0.797s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ba0b2467-7265-4c3b-8b04-1c1797287c37 tempest-CreateVolumesFromSnapshotTest-474266758 None] Lock "cinder-104c2b57-5a8c-43f8-b36c-54c6ac7a2322-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-3d034d38-f2e3-41a2-8414-0fe14ed4e024" released by "delete_volume" :: held 1.390s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['8e598d58-4ad8-430a-8920-1f4b962f2217', 'f0fdcf2c-fc97-4905-a7d7-236d15ad6ae0', '4330a7dd-f5af-4fed-80b8-46b9901e7d6a', 'de7d8e67-994b-4e1a-8d70-ba00be6a66b2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:43 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" returned: 0 in 0.762s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" released by "_copy_volume_from_snapshot" :: held 6.737s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:43 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:43 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" released by "_create_volume_from_snapshot" :: held 6.789s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.834s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b450d0e9-60a0-4850-9947-8801b957faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf', 'volume_size': 2, 'snapshot_id': '7c559204-cc91-44e7-8665-4d0e3e616bcd'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb78e9-2cd0-481f-8eba-ea8d1df8c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:43 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Volume volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf (9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf): created successfully
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eb78e9-2cd0-481f-8eba-ea8d1df8c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (da2ff8ca-d8cc-441f-a8cb-f332bc6074b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0dfba264-c245-4878-a061-58f3f8a88c45 tempest-VolumesSnapshotTestJSON-1063214283 None] Created volume successfully.
Apr 08 11:06:43 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.504s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Deleted volume successfully.
Apr 08 11:06:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2663a3f3-b9ea-444a-8cc4-15c4ab9307d5 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-3d034d38-f2e3-41a2-8414-0fe14ed4e024-delete_volume" released by "delete_volume" :: held 6.752s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-d35cb2b1-d34b-477d-91a7-7bae94f107f3-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-d35cb2b1-d34b-477d-91a7-7bae94f107f3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" acquired by "delete_volume" :: waited 0.019s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59dd30f-e925-4e16-8dbe-b8bf3f2aa9ad]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" acquired by "delete_volume" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:44 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3
Apr 08 11:06:44 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb047d8e-11ef-484c-abc9-d37475597f5c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:44 devstack sudo[87875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf
Apr 08 11:06:44 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:45 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" returned: 0 in 0.864s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:45 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf
Apr 08 11:06:45 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:45 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3" returned: 0 in 1.302s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:45 devstack sudo[87886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3
Apr 08 11:06:45 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:45 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" returned: 0 in 0.718s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf" released by "delete_volume" :: held 1.657s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['df0afe93-88f9-4994-8a57-e330feb3dfc8', '4155c6d2-e246-4354-beb9-5cddd1385665', 'c6bddb4b-3a0c-436c-a990-a55fe2f43c21', '2fbbec9d-ca74-40e2-b1fa-d5dff467a7c4'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (3f159ec7-bbc2-42bc-9c3c-7f7eef6b256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b785c1-c4de-4f7f-b94f-5e7621b7ce8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:46 devstack sudo[87889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:46 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9b785c1-c4de-4f7f-b94f-5e7621b7ce8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-47774481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b720c85-08a4-4c17-9599-cc8b98b0690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:46Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5fc69d-d333-431b-8b6a-1bc0567ee8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5fc69d-d333-431b-8b6a-1bc0567ee8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e33848-7369-48f0-b88f-c3f170e94bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e33848-7369-48f0-b88f-c3f170e94bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b720c85-08a4-4c17-9599-cc8b98b0690a', 'volume_name': 'volume-9b720c85-08a4-4c17-9599-cc8b98b0690a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178c7533-9c30-4d93-8f6a-ca675f4c4623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178c7533-9c30-4d93-8f6a-ca675f4c4623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adedda85-4be9-4a8f-9697-55f5dbc92820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:46 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Volume 9b720c85-08a4-4c17-9599-cc8b98b0690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b720c85-08a4-4c17-9599-cc8b98b0690a', 'volume_size': 1}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-47774481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b720c85-08a4-4c17-9599-cc8b98b0690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:46Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Creating volume 9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:46 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:46 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a 1073741824
Apr 08 11:06:46 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:46 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d35cb2b1-d34b-477d-91a7-7bae94f107f3" returned: 0 in 1.057s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-quobyte-d35cb2b1-d34b-477d-91a7-7bae94f107f3" released by "delete_volume" :: held 2.462s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-7c559204-cc91-44e7-8665-4d0e3e616bcd-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-7c559204-cc91-44e7-8665-4d0e3e616bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Created reservations ['12f13321-3766-4e22-b3dc-34ef169e7f69', 'b38a06af-c356-4908-bcbe-c7b96609b22a', '93432e98-64aa-4738-a1de-044f752468c9', '64cf1379-7054-4baa-bce8-47024a71db23'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Deleting offline snapshot 7c559204-cc91-44e7-8665-4d0e3e616bcd of volume a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] snapshot_file for this snap is: volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b831c-3f11-466d-9c26-271bd9f909a6]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:46 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:46 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:46 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:46 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:47 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.883s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Deleted volume successfully.
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ccc4be7-4d04-4c26-b718-790d8ff56d76 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-9f328dc6-5ce2-4e14-b0bc-71d0beb70bbf-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:47 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.641s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Deleted volume successfully.
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9302e865-41c1-4359-bcb0-1c38a8d02995 tempest-VolumesDeleteCascade-1804139365 None] Lock "cinder-d35cb2b1-d34b-477d-91a7-7bae94f107f3-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:47 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.834s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5cb70-010b-4075-9bd1-e83b6ed34560]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:47 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a 1073741824" returned: 0 in 1.318s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:47 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:47 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:47 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:06:47 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:48 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.598s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:48 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:48 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:48 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.837s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adedda85-4be9-4a8f-9697-55f5dbc92820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b720c85-08a4-4c17-9599-cc8b98b0690a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef797ab-10d3-407f-9f01-e7da4ab9adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:48 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Volume volume-9b720c85-08a4-4c17-9599-cc8b98b0690a (9b720c85-08a4-4c17-9599-cc8b98b0690a): created successfully
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef797ab-10d3-407f-9f01-e7da4ab9adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (3f159ec7-bbc2-42bc-9c3c-7f7eef6b256d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:48 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-72f51ef4-1569-4f2a-8119-774f2063c648 tempest-VolumeDependencyTests-1319803059 None] Created volume successfully.
Apr 08 11:06:48 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.682s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:49 devstack sudo[87947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd
Apr 08 11:06:49 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:49 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed.7c559204-cc91-44e7-8665-4d0e3e616bcd" returned: 0 in 0.561s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-7c559204-cc91-44e7-8665-4d0e3e616bcd" released by "_delete_snapshot" :: held 2.829s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" released by "delete_snapshot" :: held 2.859s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Creating offline snapshot 81f6c7c2-ae12-4e2a-84b7-8d518839db34 of volume 9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a7a07-1d53-4d3e-b9ae-7bfcdb79547f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['f98b040d-408e-4c61-be01-0efa098f7177', '644d07e6-264e-47b4-ba59-2f67f30530b1', '52475603-0d61-49ee-9647-0a1ef545146a', '8307f6a2-5613-4764-a8a8-45377ef039f9'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:49 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Delete snapshot completed successfully.
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6722430e-0d2f-450f-97ad-4a7994bdf537 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-7c559204-cc91-44e7-8665-4d0e3e616bcd-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:49 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:06:49 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-a2c603c8-6f11-4bfc-bded-7f02a68437ed-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-a2c603c8-6f11-4bfc-bded-7f02a68437ed-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:49 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38421056-e34f-4d99-ad42-177fd06cb182]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:50 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:50 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Flow 'volume_create_manager' (725797e7-61a0-4c88-8023-49fca2bd96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880a550f-0768-42c5-b191-031b2aecbec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880a550f-0768-42c5-b191-031b2aecbec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-261968019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6e4306-e5ef-42c5-860e-928c2911af0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a54b105bd84127b66c6cdf9cfe644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:50Z,use_quota=True,user_id='8f637c561230463f8e258215598d83fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315b77fe-6f1f-4e2e-aa56-9b5a671c2a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315b77fe-6f1f-4e2e-aa56-9b5a671c2a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9b54be-5bd7-4e01-bf1f-914b2bc0e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9b54be-5bd7-4e01-bf1f-914b2bc0e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6e4306-e5ef-42c5-860e-928c2911af0f', 'volume_name': 'volume-dc6e4306-e5ef-42c5-860e-928c2911af0f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87148f3-0288-48ea-8c5c-373eca575091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d87148f3-0288-48ea-8c5c-373eca575091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6232c5-a4b9-46da-ab80-d746215fd31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:50 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Volume dc6e4306-e5ef-42c5-860e-928c2911af0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6e4306-e5ef-42c5-860e-928c2911af0f', 'volume_size': 1}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:50 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.651s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:50 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 1G
Apr 08 11:06:50 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:50 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.646s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:50 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed
Apr 08 11:06:50 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:50 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 1G" returned: 0 in 0.480s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b720c85-08a4-4c17-9599-cc8b98b0690a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:50 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b720c85-08a4-4c17-9599-cc8b98b0690a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:06:50 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:51 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a2c603c8-6f11-4bfc-bded-7f02a68437ed" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a2c603c8-6f11-4bfc-bded-7f02a68437ed" released by "delete_volume" :: held 1.138s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['31ad438b-112a-4479-a8cf-6cc07ab83c98', '51dc99ef-292d-40ce-9250-92c5f6cff24d', 'f525d7b6-5e79-49b8-a1d9-4f3fa632e322', '4178d786-0d00-4b20-82f5-8e3173446c46'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:51 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:51 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b720c85-08a4-4c17-9599-cc8b98b0690a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.440s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:51 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 is being set with open permissions: ugo+rw
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:51 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:51 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:06:51 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:51 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:51 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Deleted volume successfully.
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a99b61ce-ec6b-4379-a0c2-07a0d66582a6 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-a2c603c8-6f11-4bfc-bded-7f02a68437ed-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:51 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:51 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info
Apr 08 11:06:51 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:52 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:52 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info is being set with open permissions: ugo+rw
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:52 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info
Apr 08 11:06:52 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (0ce07345-d4d4-47b7-b361-d2ff1ea8a554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4196445-0f1f-4e93-9d59-e8de8e7dbba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4196445-0f1f-4e93-9d59-e8de8e7dbba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1201529544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:52Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c73728-db33-41c7-98e4-88ea7f6e560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c73728-db33-41c7-98e4-88ea7f6e560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99d386-eb61-467e-ae14-665fe6cf4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99d386-eb61-467e-ae14-665fe6cf4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f', 'volume_name': 'volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed11bcb-e3a6-457c-9ab3-bd6f35089870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed11bcb-e3a6-457c-9ab3-bd6f35089870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5533f71c-5cef-4e83-8b9d-3b912f1f96f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Volume a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f', 'volume_size': 1}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:52 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.info" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.981s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.383s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-261968019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6e4306-e5ef-42c5-860e-928c2911af0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68a54b105bd84127b66c6cdf9cfe644e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:50Z,use_quota=True,user_id='8f637c561230463f8e258215598d83fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Creating volume dc6e4306-e5ef-42c5-860e-928c2911af0f {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:52 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:52 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f 1073741824
Apr 08 11:06:52 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7209b185-9f19-4f6f-bea1-4008c71690fd tempest-VolumeDependencyTests-1319803059 None] Create snapshot completed successfully
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (5978d5a9-ff4a-423f-87fe-a4db246c227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf38a18-6e0b-4c6d-b266-edea3b342d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf38a18-6e0b-4c6d-b266-edea3b342d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1511749472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61f4788-8ed5-4acc-b481-bdbae8aceeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81f6c7c2-ae12-4e2a-84b7-8d518839db34,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:53Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c05d348-4bdb-4d49-9bda-e25c4534fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c05d348-4bdb-4d49-9bda-e25c4534fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27963b72-85f5-473f-aa83-b33807ffeca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27963b72-85f5-473f-aa83-b33807ffeca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e61f4788-8ed5-4acc-b481-bdbae8aceeef', 'volume_name': 'volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef', 'volume_size': 1, 'snapshot_id': '81f6c7c2-ae12-4e2a-84b7-8d518839db34'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ffc9c-c364-464e-9dd3-0a5741a535e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af9ffc9c-c364-464e-9dd3-0a5741a535e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d96e888-b3e1-4d1a-a65c-2c2b44476832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Volume e61f4788-8ed5-4acc-b481-bdbae8aceeef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef', 'volume_size': 1, 'snapshot_id': '81f6c7c2-ae12-4e2a-84b7-8d518839db34'}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:53 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f 1073741824" returned: 0 in 0.563s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:53 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f
Apr 08 11:06:53 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:53 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f" returned: 0 in 0.498s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1201529544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:52Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Creating volume a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:53 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6232c5-a4b9-46da-ab80-d746215fd31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6e4306-e5ef-42c5-860e-928c2911af0f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab345344-26de-40d4-8dcf-4569f2bc06ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:53 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f 1073741824
Apr 08 11:06:53 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Volume volume-dc6e4306-e5ef-42c5-860e-928c2911af0f (dc6e4306-e5ef-42c5-860e-928c2911af0f): created successfully
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab345344-26de-40d4-8dcf-4569f2bc06ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Flow 'volume_create_manager' (725797e7-61a0-4c88-8023-49fca2bd96ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:53 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-915e0fe8-6e22-4746-9e59-edbde1625b70 tempest-VolumesMetadataTest-1775175539 None] Created volume successfully.
Apr 08 11:06:54 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f 1073741824" returned: 0 in 0.731s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:54 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:06:54 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:54 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.800s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34-e61f4788-8ed5-4acc-b481-bdbae8aceeef" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5533f71c-5cef-4e83-8b9d-3b912f1f96f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7c3947-6ad8-4cd9-9963-363d1c2fc371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34-e61f4788-8ed5-4acc-b481-bdbae8aceeef" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Creating volume e61f4788-8ed5-4acc-b481-bdbae8aceeef from snapshot 81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:06:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:55 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Volume volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f (a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f): created successfully
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7c3947-6ad8-4cd9-9963-363d1c2fc371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (0ce07345-d4d4-47b7-b361-d2ff1ea8a554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] snapshot: 81f6c7c2-ae12-4e2a-84b7-8d518839db34, volume: e61f4788-8ed5-4acc-b481-bdbae8aceeef,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-39673d60-6c52-4044-baaf-abacfbb58daf tempest-VolumesSnapshotTestJSON-1063214283 None] Created volume successfully.
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Acquiring lock "cinder-dc6e4306-e5ef-42c5-860e-928c2911af0f-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "cinder-dc6e4306-e5ef-42c5-860e-928c2911af0f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab00737-a1cb-4260-ba6a-ad506e3376b3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Acquiring lock "cinder-quobyte-dc6e4306-e5ef-42c5-860e-928c2911af0f" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "cinder-quobyte-dc6e4306-e5ef-42c5-860e-928c2911af0f" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a745b6bc-05cd-4486-b8b3-20f632bd0199]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:55 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:06:55 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:55 devstack sudo[88045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f
Apr 08 11:06:55 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:55 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.846s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b720c85-08a4-4c17-9599-cc8b98b0690a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad386418-3c7b-436d-89ec-bd2bdb825711]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:56 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:06:56 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:56 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f" returned: 0 in 0.902s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:56 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f
Apr 08 11:06:56 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Flow 'volume_create_manager' (695b4081-0612-4486-a6b4-299244e064aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a7a473-d74b-416b-aa20-57c70ed544c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a7a473-d74b-416b-aa20-57c70ed544c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2014127984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9bd506-0507-47b9-950c-c9e7fe9b3649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4ac68d901f4a81a045da0e2d3d982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:56Z,use_quota=True,user_id='9a51442239054695b1bc4dff8686f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ec0e5-f22b-4a17-8908-9446f73695b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ec0e5-f22b-4a17-8908-9446f73695b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eec932-4c5a-4bb8-a3f9-e58426af4608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4eec932-4c5a-4bb8-a3f9-e58426af4608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9bd506-0507-47b9-950c-c9e7fe9b3649', 'volume_name': 'volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacb265d-0ee0-419c-9c81-2b370bcc5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aacb265d-0ee0-419c-9c81-2b370bcc5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f0b6b-b68f-49a8-8e2f-b20596d96107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:06:56 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Volume 1d9bd506-0507-47b9-950c-c9e7fe9b3649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649', 'volume_size': 1}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:56 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.712s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:56 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef
Apr 08 11:06:56 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:56 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-dc6e4306-e5ef-42c5-860e-928c2911af0f" returned: 0 in 0.639s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "cinder-quobyte-dc6e4306-e5ef-42c5-860e-928c2911af0f" released by "delete_volume" :: held 1.577s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Created reservations ['c182a429-6cb2-4fe6-a874-0ec0117c424b', 'cb66bdca-ea83-4020-83b8-33bcd1d1a18a', '9f654a99-5dd8-4bac-8934-298249aa3ff9', '00cbc323-9fa2-495a-86a4-8a3b7c595a33'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:06:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:06:56 devstack sudo[88066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:06:56 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:06:58 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 1.287s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:58 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:06:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Deleted volume successfully.
Apr 08 11:06:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4550265a-1e49-4353-9bc0-89103ad5fd49 tempest-VolumesMetadataTest-1775175539 None] Lock "cinder-dc6e4306-e5ef-42c5-860e-928c2911af0f-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:06:59 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 08 11:06:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef" returned: 0 in 3.298s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:06:59 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c63614-8175-4457-8fc6-4ceb44d383c9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:06:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:00 devstack sudo[88088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:07:00 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:00 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.730s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:00 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a, size 1024.00 MB, duration 3.30 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:07:00 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Converted 1024.00 MB image at 310.45 MB/s
Apr 08 11:07:00 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef is being set with open permissions: ugo+rw
Apr 08 11:07:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:00 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef
Apr 08 11:07:00 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Flow 'volume_create_manager' (354e108c-7e06-4deb-8e57-345fe2e87fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fae087-b89f-4c2f-8a6b-ca99c3ae58f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fae087-b89f-4c2f-8a6b-ca99c3ae58f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730410971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de380ea1-0f60-46b7-b901-2449919ead84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c4c9dfa86646c7867d9c5f913eb289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:01Z,use_quota=True,user_id='8dd544e15a0d46c5ae6e077f8e95863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1ca6af-0e30-48cf-bd03-9ee91fbdda06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1ca6af-0e30-48cf-bd03-9ee91fbdda06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1657c345-ac6a-4766-bdd1-7100b1b907aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.image.glance [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Creating Keystone auth plugin from conf {{(pid=82670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 08 11:07:01 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef" returned: 0 in 0.603s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1657c345-ac6a-4766-bdd1-7100b1b907aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de380ea1-0f60-46b7-b901-2449919ead84', 'volume_name': 'volume-de380ea1-0f60-46b7-b901-2449919ead84', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea24f5150>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298428fd-6c0a-4171-8af1-0d068beba3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298428fd-6c0a-4171-8af1-0d068beba3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a02e9c-878b-4295-be2b-f7eb71732052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Volume de380ea1-0f60-46b7-b901-2449919ead84: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de380ea1-0f60-46b7-b901-2449919ead84', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea24f5150>}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Trying to clone de380ea1-0f60-46b7-b901-2449919ead84 from image e79cd67c-0f76-457d-af5e-4472f723e6f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]). {{(pid=82670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" released by "_copy_volume_from_snapshot" :: held 6.318s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34-e61f4788-8ed5-4acc-b481-bdbae8aceeef" released by "_create_volume_from_snapshot" :: held 6.354s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.373s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.457s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Creating offline snapshot 3e70c8ba-c075-4420-8b3f-8e037873bd32 of volume a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d96e888-b3e1-4d1a-a65c-2c2b44476832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef', 'volume_size': 1, 'snapshot_id': '81f6c7c2-ae12-4e2a-84b7-8d518839db34'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18986127-3ec3-46b9-a4b9-83074b2a5d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Volume volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef (e61f4788-8ed5-4acc-b481-bdbae8aceeef): created successfully
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18986127-3ec3-46b9-a4b9-83074b2a5d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (5978d5a9-ff4a-423f-87fe-a4db246c227d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1ab1a2-062f-4187-8342-d129d815c49a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:01 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-494e4578-946d-4df2-848e-4bb0bb0d360b tempest-VolumeDependencyTests-1319803059 None] Created volume successfully.
Apr 08 11:07:01 devstack sudo[88098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:01 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 08 11:07:01 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Image download 20.69 MB at 20.69 MB/s
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a2463c-fccc-4a50-ba1c-741f3f00397b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:01 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD
Apr 08 11:07:01 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:01 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:02 devstack sudo[88142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 1G
Apr 08 11:07:02 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:02 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 is fetched for user 8dd544e15a0d46c5ae6e077f8e95863a. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-81f6c7c2-ae12-4e2a-84b7-8d518839db34-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-81f6c7c2-ae12-4e2a-84b7-8d518839db34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Deleting offline snapshot 81f6c7c2-ae12-4e2a-84b7-8d518839db34 of volume 9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] snapshot_file for this snap is: volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf33c68-991e-4b55-a945-d0cd36b01638]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c91bd6-a658-4a60-bce4-de9c9d2f8ad3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:02 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:07:02 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:02 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD
Apr 08 11:07:02 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:02 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:02 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:02 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 1G" returned: 0 in 0.988s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:03 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:03 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:03 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD" returned: 0 in 0.805s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:03 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.803s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.517s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b720c85-08a4-4c17-9599-cc8b98b0690a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f06836-42ec-41cc-8482-1763e5fb2fb7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:03 devstack sudo[88162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:07:03 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:03 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 0.544s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 is being set with open permissions: ugo+rw
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:03 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:03 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:03 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.559s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:03 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:07:03 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:03 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 0.420s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:03 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info
Apr 08 11:07:03 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:04 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.550s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:04 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34
Apr 08 11:07:04 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:04 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info" returned: 0 in 0.528s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:04 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info is being set with open permissions: ugo+rw
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:04 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info
Apr 08 11:07:04 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:04 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a.81f6c7c2-ae12-4e2a-84b7-8d518839db34" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-81f6c7c2-ae12-4e2a-84b7-8d518839db34" released by "_delete_snapshot" :: held 2.505s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" released by "delete_snapshot" :: held 2.526s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Created reservations ['8e94aa48-5f6a-4bb8-9a8d-b8506b3c0723', 'c88e8f1d-8406-4ec1-80fe-b717924e4058', '58362379-ccc2-4d02-b674-bb71049b06e0', 'a3d23b8e-18ca-44b5-a876-6b9997b8bbeb'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Delete snapshot completed successfully.
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-69b9ec93-519f-4cb8-b853-ec86bc5b16d0 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-81f6c7c2-ae12-4e2a-84b7-8d518839db34-delete_snapshot" released by "delete_snapshot" :: held 2.618s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:04 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.info" returned: 0 in 0.429s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.601s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.375s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2014127984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9bd506-0507-47b9-950c-c9e7fe9b3649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4ac68d901f4a81a045da0e2d3d982e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:06:56Z,use_quota=True,user_id='9a51442239054695b1bc4dff8686f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Creating volume 1d9bd506-0507-47b9-950c-c9e7fe9b3649 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:04 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-978af42a-5c34-48ee-bdf4-5d82cca110b1 tempest-VolumesSnapshotTestJSON-1063214283 None] Create snapshot completed successfully
Apr 08 11:07:04 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 1073741824
Apr 08 11:07:04 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-9b720c85-08a4-4c17-9599-cc8b98b0690a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-9b720c85-08a4-4c17-9599-cc8b98b0690a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950f0dc-a2fd-4851-8f6e-07cb6be1ce82]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:05 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:07:05 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:05 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 1073741824" returned: 0 in 0.809s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (b68bc1f0-f853-46ea-b871-0b4bf77220e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:05 devstack sudo[88194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649
Apr 08 11:07:05 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbfb48f-6879-4e11-9c20-6834699834e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbfb48f-6879-4e11-9c20-6834699834e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1861983863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29c7d27-4bce-4bf6-abf7-26f7a115c502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac763fc37df4fa7bfe2818b4ea6d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e70c8ba-c075-4420-8b3f-8e037873bd32,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:06Z,use_quota=True,user_id='755c8e4c8f9642af86e9decb82c73c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7670cf1b-eb97-4f1b-b145-323366a0e93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7670cf1b-eb97-4f1b-b145-323366a0e93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9049aa-a3ea-4eab-9ff7-fb03bc980a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9049aa-a3ea-4eab-9ff7-fb03bc980a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b29c7d27-4bce-4bf6-abf7-26f7a115c502', 'volume_name': 'volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502', 'volume_size': 1, 'snapshot_id': '3e70c8ba-c075-4420-8b3f-8e037873bd32'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef748e0-1f71-4937-a3ad-7db5ed6048a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef748e0-1f71-4937-a3ad-7db5ed6048a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01144987-54d0-4db7-af8d-f1b1dd5b2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:05 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume b29c7d27-4bce-4bf6-abf7-26f7a115c502: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502', 'volume_size': 1, 'snapshot_id': '3e70c8ba-c075-4420-8b3f-8e037873bd32'}
Apr 08 11:07:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:06 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.599s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:06 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a
Apr 08 11:07:06 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:06 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.235s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730410971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de380ea1-0f60-46b7-b901-2449919ead84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c4c9dfa86646c7867d9c5f913eb289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:01Z,use_quota=True,user_id='8dd544e15a0d46c5ae6e077f8e95863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Creating volume de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:06 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f0b6b-b68f-49a8-8e2f-b20596d96107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d5991-dfca-4e49-9a8f-08de1100399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:06 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1073741824
Apr 08 11:07:06 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:06 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Volume volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 (1d9bd506-0507-47b9-950c-c9e7fe9b3649): created successfully
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540d5991-dfca-4e49-9a8f-08de1100399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Flow 'volume_create_manager' (695b4081-0612-4486-a6b4-299244e064aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a949c936-6879-4719-a16c-26874918bd99 tempest-ServerRescueNegativeTestJSON-506086504 None] Created volume successfully.
Apr 08 11:07:06 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-9b720c85-08a4-4c17-9599-cc8b98b0690a" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-9b720c85-08a4-4c17-9599-cc8b98b0690a" released by "delete_volume" :: held 1.181s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Created reservations ['8ebedfe9-fba3-47a6-9b4c-e7405c380028', '2f92947d-3f30-42c9-8fae-8ef7d6bbaec0', 'c2c4de3b-a558-4212-a617-8bb11e1ce216', '7c763328-c91c-42b4-88d8-02cff59d6904'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:06 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:06 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:07 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1073741824" returned: 0 in 0.682s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:07 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:07 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:07 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.456s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Deleted volume successfully.
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04f5255d-8e8e-43ef-92e2-b719be8436ef tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-9b720c85-08a4-4c17-9599-cc8b98b0690a-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:07 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.571s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32-b29c7d27-4bce-4bf6-abf7-26f7a115c502" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32-b29c7d27-4bce-4bf6-abf7-26f7a115c502" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Creating volume b29c7d27-4bce-4bf6-abf7-26f7a115c502 from snapshot 3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] snapshot: 3e70c8ba-c075-4420-8b3f-8e037873bd32, volume: b29c7d27-4bce-4bf6-abf7-26f7a115c502,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Attempting download of e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume de380ea1-0f60-46b7-b901-2449919ead84. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13193b-9b71-4d85-960d-db29381a7c0d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[31886be1-54a6-4621-9050-a36f6af1c1a5]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:07 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:07 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:07 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid
Apr 08 11:07:07 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (a9b9748e-855b-4f48-88f7-825d58b0c36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35dc37a-e1f4-459a-ba93-5ab086035388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35dc37a-e1f4-459a-ba93-5ab086035388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096223927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a4769b-10a2-4f81-96ba-d37e91b6c209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:08Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334b89dc-33e6-4182-8a60-22308dfd0045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334b89dc-33e6-4182-8a60-22308dfd0045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033ccba-6c38-464e-afe1-e2f7d2b5c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6033ccba-6c38-464e-afe1-e2f7d2b5c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a4769b-10a2-4f81-96ba-d37e91b6c209', 'volume_name': 'volume-08a4769b-10a2-4f81-96ba-d37e91b6c209', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205863b-ee85-43ee-b986-42ffba528f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205863b-ee85-43ee-b986-42ffba528f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:08 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8436a8-3b07-4eb5-878f-4746cfa060f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:08 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Volume 08a4769b-10a2-4f81-96ba-d37e91b6c209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a4769b-10a2-4f81-96ba-d37e91b6c209', 'volume_size': 1}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 0.612s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a84979-8bc8-4e56-9dec-cf350d76729c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:08 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:08 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:08 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid" returned: 0 in 0.830s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:08 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid
Apr 08 11:07:08 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:08 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:07:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:08 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502
Apr 08 11:07:08 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:09 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid" returned: 1 in 0.575s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_2lgb2pid' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc8114-2a11-436f-8574-d48a61850cb3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:09 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD
Apr 08 11:07:09 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:09 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD" returned: 0 in 0.940s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] e79cd67c-0f76-457d-af5e-4472f723e6f9 was qcow2, converting to raw {{(pid=82670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 08 11:07:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:10 devstack sudo[88253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:10 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:12 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502" returned: 0 in 3.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c418c45d-c2a2-4952-8156-a4fafacac342]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:12 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:12 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:12 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 2.600s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_c4w67cjqdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:07:12 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Converted 112.00 MB image at 43.04 MB/s
Apr 08 11:07:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:12 devstack sudo[88293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1G
Apr 08 11:07:12 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:13 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.787s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f, size 1024.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:07:13 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Converted 1024.00 MB image at 292.95 MB/s
Apr 08 11:07:13 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 is being set with open permissions: ugo+rw
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:13 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 1G" returned: 0 in 0.428s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:13 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502
Apr 08 11:07:13 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2bffe9-6e31-4121-9566-032f3d1e00ea]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:13 devstack sudo[88311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:13 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:13 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502" returned: 0 in 0.436s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" released by "_copy_volume_from_snapshot" :: held 5.940s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32-b29c7d27-4bce-4bf6-abf7-26f7a115c502" released by "_create_volume_from_snapshot" :: held 5.973s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.990s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.279s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2096223927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a4769b-10a2-4f81-96ba-d37e91b6c209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:08Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Creating volume 08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:13 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:13 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 1073741824
Apr 08 11:07:13 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01144987-54d0-4db7-af8d-f1b1dd5b2b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502', 'volume_size': 1, 'snapshot_id': '3e70c8ba-c075-4420-8b3f-8e037873bd32'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115ac6b3-9711-4b8a-89f1-8665f40b7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:13 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Volume volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 (b29c7d27-4bce-4bf6-abf7-26f7a115c502): created successfully
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115ac6b3-9711-4b8a-89f1-8665f40b7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Flow 'volume_create_manager' (b68bc1f0-f853-46ea-b871-0b4bf77220e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:13 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-63336781-ae4a-4d90-b2b8-ac4e44ae13bd tempest-VolumesSnapshotTestJSON-1063214283 None] Created volume successfully.
Apr 08 11:07:13 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:13 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:13 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:13 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 1073741824" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:14 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:14 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:14 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 1 in 0.534s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Downloaded image e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume de380ea1-0f60-46b7-b901-2449919ead84 successfully. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 for user 8dd544e15a0d46c5ae6e077f8e95863a is deleted. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Marking volume de380ea1-0f60-46b7-b901-2449919ead84 as bootable. {{(pid=82670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Copying metadata from image e79cd67c-0f76-457d-af5e-4472f723e6f9 to de380ea1-0f60-46b7-b901-2449919ead84. {{(pid=82670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Creating volume glance metadata for volume de380ea1-0f60-46b7-b901-2449919ead84 backed by image e79cd67c-0f76-457d-af5e-4472f723e6f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a02e9c-878b-4295-be2b-f7eb71732052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de380ea1-0f60-46b7-b901-2449919ead84', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea24f5150>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fca9c-6365-4ef4-9188-a5dfee957f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:14 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Volume volume-de380ea1-0f60-46b7-b901-2449919ead84 (de380ea1-0f60-46b7-b901-2449919ead84): created successfully
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44fca9c-6365-4ef4-9188-a5dfee957f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Flow 'volume_create_manager' (354e108c-7e06-4deb-8e57-345fe2e87fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a74b58a7-0898-4e87-84ea-acc0bd92d1f6 tempest-VolumesExtendTest-583003908 None] Created volume successfully.
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:14 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.492s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.109s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8436a8-3b07-4eb5-878f-4746cfa060f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a4769b-10a2-4f81-96ba-d37e91b6c209', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52799fad-2f56-4fea-9379-d6cd4ece51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c7816a-8d34-4c0b-a83f-a614c2c3bb28]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-b29c7d27-4bce-4bf6-abf7-26f7a115c502-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:14 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Volume volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 (08a4769b-10a2-4f81-96ba-d37e91b6c209): created successfully
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52799fad-2f56-4fea-9379-d6cd4ece51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (a9b9748e-855b-4f48-88f7-825d58b0c36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-b29c7d27-4bce-4bf6-abf7-26f7a115c502-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1189bd0d-392c-4285-9bf0-392c9747caa8 tempest-VolumeDependencyTests-1319803059 None] Created volume successfully.
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f4cc9-83bb-4cf7-b093-7e55738b9ce8]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:14 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:14 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:14 devstack sudo[88332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502
Apr 08 11:07:14 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (234fca95-fd0b-4ae9-a32d-c1aa8529d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e39d71-fcd5-43c8-98c4-b84076291b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e39d71-fcd5-43c8-98c4-b84076291b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1285030180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85256553-8d00-47cb-9794-d09031abf5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d66769c0d4714eb5a5e6a7c47f3815e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=08a4769b-10a2-4f81-96ba-d37e91b6c209,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:15Z,use_quota=True,user_id='cd49ad6e6e494d8f98f5055b4c0c2706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1983169-6854-4c69-bbca-eb4f361d52c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1983169-6854-4c69-bbca-eb4f361d52c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce85b35b-a280-4122-a122-148bbbfa1810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce85b35b-a280-4122-a122-148bbbfa1810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85256553-8d00-47cb-9794-d09031abf5ad', 'volume_name': 'volume-85256553-8d00-47cb-9794-d09031abf5ad', 'volume_size': 1, 'source_volid': '08a4769b-10a2-4f81-96ba-d37e91b6c209', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e16a7bf-c212-4d34-8749-d9e6ecc83bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e16a7bf-c212-4d34-8749-d9e6ecc83bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8c760d-8439-479d-8eb8-a87063952ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Volume 85256553-8d00-47cb-9794-d09031abf5ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85256553-8d00-47cb-9794-d09031abf5ad', 'volume_size': 1, 'source_volid': '08a4769b-10a2-4f81-96ba-d37e91b6c209', 'source_volstatus': 'available'}
Apr 08 11:07:15 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502" returned: 0 in 0.560s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:15 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502
Apr 08 11:07:15 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:15 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 0.727s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:15 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:15 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:15 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b29c7d27-4bce-4bf6-abf7-26f7a115c502" returned: 0 in 0.414s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-b29c7d27-4bce-4bf6-abf7-26f7a115c502" released by "delete_volume" :: held 1.014s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['11b6871e-59f5-49e5-99dd-ec0a666a1a7a', '0f8dc37e-042d-4594-8cf3-6781f17ef88e', 'd205cff5-75d9-4f36-855b-1229675dbebd', 'e759a30c-a607-449b-a4e9-9a8860746823'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:15 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:15 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:15 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 1 in 0.497s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 2G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 2G" returned: 0 in 0.048s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.314s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.628s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:15 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Cloning volume 08a4769b-10a2-4f81-96ba-d37e91b6c209 to volume 85256553-8d00-47cb-9794-d09031abf5ad
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Creating offline snapshot ac0e0cfb-bb3e-4714-8e54-fd67c818282b of volume 08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:07:15 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3fdd42da-de10-43b2-97b5-1277c29764d1 tempest-VolumesExtendTest-583003908 None] Extend volume completed successfully.
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc8601-bb94-4ee7-9def-bf2e40922f11]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:15 devstack sudo[88359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:15 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:16 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.430s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Deleted volume successfully.
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7960eea9-2e2c-4e79-b6c1-302412d9a77f tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-b29c7d27-4bce-4bf6-abf7-26f7a115c502-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:16 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.517s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:16 devstack sudo[88365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b 1G
Apr 08 11:07:16 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-de380ea1-0f60-46b7-b901-2449919ead84-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "cinder-de380ea1-0f60-46b7-b901-2449919ead84-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-quobyte-de380ea1-0f60-46b7-b901-2449919ead84" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-de380ea1-0f60-46b7-b901-2449919ead84" acquired by "delete_volume" :: waited 0.023s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f3fd42-b02d-4660-b176-a4a6f33b7eda]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-3e70c8ba-c075-4420-8b3f-8e037873bd32-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-3e70c8ba-c075-4420-8b3f-8e037873bd32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Deleting offline snapshot 3e70c8ba-c075-4420-8b3f-8e037873bd32 of volume a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] snapshot_file for this snap is: volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd4a17-3e18-498a-bfbf-24dddf15951a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:17 devstack sudo[88393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:17 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:17 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:17 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:17 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b 1G" returned: 0 in 0.879s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:17 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:17 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:18 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.733s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:18 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b is being set with open permissions: ugo+rw
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:18 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:18 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:18 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 1.270s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:18 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 1.139s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:18 devstack sudo[88415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:18 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[139e4791-64a2-474b-860f-de370acad17d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:18 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:18 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:18 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.641s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:18 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info
Apr 08 11:07:18 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:18 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 1 in 0.758s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:07:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:18 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84
Apr 08 11:07:18 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:19 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.815s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:19 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:19 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:19 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-de380ea1-0f60-46b7-b901-2449919ead84" returned: 0 in 0.709s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-de380ea1-0f60-46b7-b901-2449919ead84" released by "delete_volume" :: held 2.829s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Created reservations ['4c28c1f3-335f-44a8-ba3f-175a03faab6e', '12a11dd7-97b6-4509-a6b9-9931bf20db3d', '481bdf6a-3e60-4f4a-9a6e-c149643d5adb', '4586a61f-dc59-4674-8b51-40f1533c72f1'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:19 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info" returned: 0 in 1.054s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:19 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info is being set with open permissions: ugo+rw
Apr 08 11:07:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:19 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:19 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:19 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info
Apr 08 11:07:19 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:20 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 0.987s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:20 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32
Apr 08 11:07:20 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:20 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.info" returned: 0 in 0.602s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] snapshot: ac0e0cfb-bb3e-4714-8e54-fd67c818282b, volume: 85256553-8d00-47cb-9794-d09031abf5ad,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:07:20 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.731s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Deleted volume successfully.
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c171e8f-88f7-4762-8ca9-712a59cdd32a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6d75d22a-49a7-43de-9a8a-7cb289c50d71 tempest-VolumesExtendTest-583003908 None] Lock "cinder-de380ea1-0f60-46b7-b901-2449919ead84-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:20 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:20 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Flow 'volume_create_manager' (ff4853f7-2037-439d-b75f-25527ad4d52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4a5f86-9780-44be-ad32-383ae53eb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec4a5f86-9780-44be-ad32-383ae53eb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1527502546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1ed335-8115-4361-b638-ad59d6f6b182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c4c9dfa86646c7867d9c5f913eb289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:21Z,use_quota=True,user_id='8dd544e15a0d46c5ae6e077f8e95863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3a6c31-add5-4713-a193-d1945b9a6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:20 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3a6c31-add5-4713-a193-d1945b9a6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d907fc-6a06-4cf5-9c1c-1272184cafad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d907fc-6a06-4cf5-9c1c-1272184cafad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1ed335-8115-4361-b638-ad59d6f6b182', 'volume_name': 'volume-4a1ed335-8115-4361-b638-ad59d6f6b182', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0869b9bb-d158-45dd-b7b8-cc16b24d42c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0869b9bb-d158-45dd-b7b8-cc16b24d42c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee8abb9-30d2-4df5-874d-1734f302fc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Volume 4a1ed335-8115-4361-b638-ad59d6f6b182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1ed335-8115-4361-b638-ad59d6f6b182', 'volume_size': 1}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f.3e70c8ba-c075-4420-8b3f-8e037873bd32" returned: 0 in 0.841s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-3e70c8ba-c075-4420-8b3f-8e037873bd32" released by "_delete_snapshot" :: held 4.011s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" released by "delete_snapshot" :: held 4.050s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['26873e6c-3fe7-4a35-a067-a5b16f52e175', '1c4a8c02-5637-4015-8000-7f871eef2bc4', '2b4ec571-eba0-4e03-bad1-963ea5036d65', 'ae5b2acc-13ab-43ff-987d-999856b1fb71'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Delete snapshot completed successfully.
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5aa90e4f-a0d0-49c0-a5bb-6a152b7d4dcb tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-3e70c8ba-c075-4420-8b3f-8e037873bd32-delete_snapshot" released by "delete_snapshot" :: held 4.172s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:21 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.875s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a4769b-10a2-4f81-96ba-d37e91b6c209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cd182-efa4-4c06-80f6-95c6dc1b0f39]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c11db-771d-4601-9616-ff9d1247d7a5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:21 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:21 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:21 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:21 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:21 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.601s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:22 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:07:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:22 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad
Apr 08 11:07:22 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:22 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 0.534s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:22 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f
Apr 08 11:07:22 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:23 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" returned: 0 in 1.172s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:23 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f" released by "delete_volume" :: held 1.842s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:23 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['b819bf73-2fc7-40a6-944e-7a648dc262f3', '77849b27-ecbc-458c-a98b-901e2ebee009', '1474d314-2400-49ab-8f01-df3a517b77bf', 'acd5fabb-9d88-4506-bc9f-34b7c2e6fce8'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:24 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:24 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cf665-30c3-4863-9d6a-1135683ef3ba]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:25 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6
Apr 08 11:07:25 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:25 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad" returned: 0 in 3.699s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1480882-3a10-48a8-b23e-4c38607f045d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:25 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:25 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Acquiring lock "cinder-1d9bd506-0507-47b9-950c-c9e7fe9b3649-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "cinder-1d9bd506-0507-47b9-950c-c9e7fe9b3649-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:25 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 1.903s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Deleted volume successfully.
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c49131d0-e229-4ba3-bd04-0dc091e26b5d tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-a24a60ea-d39c-4ea1-9e3b-8d1bf9b2146f-delete_volume" released by "delete_volume" :: held 4.601s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Acquiring lock "cinder-quobyte-1d9bd506-0507-47b9-950c-c9e7fe9b3649" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "cinder-quobyte-1d9bd506-0507-47b9-950c-c9e7fe9b3649" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d52fc6-b5ca-4ca6-b59c-dbb3bbaf5de4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:26 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649
Apr 08 11:07:26 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:26 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" returned: 0 in 1.421s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:26 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6
Apr 08 11:07:26 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:26 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.929s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209, size 1024.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:07:26 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Converted 1024.00 MB image at 276.73 MB/s
Apr 08 11:07:26 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad is being set with open permissions: ugo+rw
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:26 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad
Apr 08 11:07:26 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:26 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649" returned: 0 in 0.803s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:26 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649
Apr 08 11:07:26 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:27 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-quobyte-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6" released by "delete_volume" :: held 2.191s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Created reservations ['843429e7-fa93-458b-966b-3237826704b5', '1c62795a-2385-4db3-9447-1916b273ec54', '06258053-0ca3-439e-8309-4348a14ce50f', '4d9bbdd7-490c-4641-afde-789b4045aa8f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:27 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:27 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:27 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad" returned: 0 in 0.633s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" released by "_copy_volume_from_snapshot" :: held 6.856s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-ac0e0cfb-bb3e-4714-8e54-fd67c818282b" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-ac0e0cfb-bb3e-4714-8e54-fd67c818282b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Deleting offline snapshot ac0e0cfb-bb3e-4714-8e54-fd67c818282b of volume 08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] snapshot_file for this snap is: volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6acdc2c-5d50-4c13-b764-0c5019668472]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:27 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:27 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:27 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Deleted volume successfully.
Apr 08 11:07:27 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1d9bd506-0507-47b9-950c-c9e7fe9b3649" returned: 0 in 0.739s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e26cea2f-5f98-4637-af73-d3bff87c5506 tempest-VolumesSnapshotTestJSON-1063214283 None] Lock "cinder-d19b4bac-0159-4afc-a2eb-cb71eb25d3d6-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "cinder-quobyte-1d9bd506-0507-47b9-950c-c9e7fe9b3649" released by "delete_volume" :: held 1.668s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Created reservations ['41637f87-b11f-4876-90a1-ddaf20ddca7c', '6082537a-130f-4ac6-a404-cefb5372cdd7', 'ce7725d1-b0dc-4a22-803d-353ef8260f64', 'ba0cf956-fdea-48f7-9a9c-6b33921f569d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:27 devstack sudo[88616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:27 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:28 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.646s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a4769b-10a2-4f81-96ba-d37e91b6c209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f14c6-ddf8-4a22-976b-5cdd65b23c73]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:28 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:28 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:28 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Deleted volume successfully.
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6cded7f8-1166-4255-a2c1-4265b2b2f262 tempest-ServerRescueNegativeTestJSON-506086504 None] Lock "cinder-1d9bd506-0507-47b9-950c-c9e7fe9b3649-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:28 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.855s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:28 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:28 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:29 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.676s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:29 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b
Apr 08 11:07:29 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:30 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209.ac0e0cfb-bb3e-4714-8e54-fd67c818282b" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-ac0e0cfb-bb3e-4714-8e54-fd67c818282b" released by "_delete_snapshot" :: held 2.774s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.306s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.140s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1527502546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1ed335-8115-4361-b638-ad59d6f6b182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0c4c9dfa86646c7867d9c5f913eb289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:21Z,use_quota=True,user_id='8dd544e15a0d46c5ae6e077f8e95863a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Creating volume 4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:30 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:30 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 1073741824
Apr 08 11:07:30 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8c760d-8439-479d-8eb8-a87063952ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85256553-8d00-47cb-9794-d09031abf5ad', 'volume_size': 1, 'source_volid': '08a4769b-10a2-4f81-96ba-d37e91b6c209', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a4ffba-2317-4d68-bf1b-e06006bd59a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:30 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Volume volume-85256553-8d00-47cb-9794-d09031abf5ad (85256553-8d00-47cb-9794-d09031abf5ad): created successfully
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a4ffba-2317-4d68-bf1b-e06006bd59a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Flow 'volume_create_manager' (234fca95-fd0b-4ae9-a32d-c1aa8529d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9bbca682-b31a-4c4d-9dfe-79efbad9a1cd tempest-VolumeDependencyTests-1319803059 None] Created volume successfully.
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-08a4769b-10a2-4f81-96ba-d37e91b6c209-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-08a4769b-10a2-4f81-96ba-d37e91b6c209-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-08a4769b-10a2-4f81-96ba-d37e91b6c209" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-08a4769b-10a2-4f81-96ba-d37e91b6c209" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f7f07-4e93-42b8-a149-e340a9753003]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:30 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 1073741824" returned: 0 in 0.681s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:30 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:30 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:31 devstack sudo[88676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:31 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:31 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.696s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee8abb9-30d2-4df5-874d-1734f302fc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1ed335-8115-4361-b638-ad59d6f6b182', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f6ba57-f02e-4ad4-b658-c9ebbf92fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:31 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Volume volume-4a1ed335-8115-4361-b638-ad59d6f6b182 (4a1ed335-8115-4361-b638-ad59d6f6b182): created successfully
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f6ba57-f02e-4ad4-b658-c9ebbf92fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Flow 'volume_create_manager' (ff4853f7-2037-439d-b75f-25527ad4d52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0c482888-8fc5-46c6-b82e-c1856bf6408b tempest-VolumesExtendTest-583003908 None] Created volume successfully.
Apr 08 11:07:31 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.780s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:31 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209
Apr 08 11:07:31 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:32 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-08a4769b-10a2-4f81-96ba-d37e91b6c209" returned: 0 in 0.538s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-08a4769b-10a2-4f81-96ba-d37e91b6c209" released by "delete_volume" :: held 1.375s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Created reservations ['d845bf12-8e4e-4e4f-8f28-3112a63ea0ee', 'a080e2a2-6806-474e-b6be-f54bf14de134', 'ff769840-78bb-46a9-b4c0-fb0e662487ad', '039484dd-b6d0-4025-9bb5-90c0efd766a5'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:32 devstack sudo[88690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:32 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Creating offline snapshot e83735b4-e5b2-4d6d-aa4c-78e54b28705b of volume 4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[06da24f5-c2c7-40b7-aeb0-f306bb8548c5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:32 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:32 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:32 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.503s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Deleted volume successfully.
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-95f6594e-4824-457c-a88a-f421de5cc2df tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-08a4769b-10a2-4f81-96ba-d37e91b6c209-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-85256553-8d00-47cb-9794-d09031abf5ad-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-85256553-8d00-47cb-9794-d09031abf5ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:32 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.580s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" acquired by "delete_volume" :: waited 0.025s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:33 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b 1G
Apr 08 11:07:33 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495b44a-e291-4c2f-bbd4-76d794e4011b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:33 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad
Apr 08 11:07:33 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:33 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b 1G" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1ed335-8115-4361-b638-ad59d6f6b182 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:33 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1ed335-8115-4361-b638-ad59d6f6b182 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b
Apr 08 11:07:33 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=135,cinder:INSERT=55,cinder:UPDATE=172,cinder:DELETE=13 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:07:33 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad" returned: 0 in 0.520s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:33 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad
Apr 08 11:07:33 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:33 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1ed335-8115-4361-b638-ad59d6f6b182 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:33 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b is being set with open permissions: ugo+rw
Apr 08 11:07:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:33 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b
Apr 08 11:07:33 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:34 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85256553-8d00-47cb-9794-d09031abf5ad" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-85256553-8d00-47cb-9794-d09031abf5ad" released by "delete_volume" :: held 1.006s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Created reservations ['df045a36-36fd-4510-8db2-6c4fe5a1b01b', '41b17724-a82e-4f52-9361-9f5ea69b88f9', 'e4dc2746-7dbd-49e7-9354-df15ec96d855', '3592e9f8-e556-4b89-97b2-035e502dda9d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:34 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:34 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:34 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:34 devstack sudo[88721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info
Apr 08 11:07:34 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:34 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.463s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:34 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Deleted volume successfully.
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-8fba5990-36e3-490b-8208-e5f5baa46ec2 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-85256553-8d00-47cb-9794-d09031abf5ad-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:34 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info" returned: 0 in 0.423s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:34 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info is being set with open permissions: ugo+rw
Apr 08 11:07:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:34 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info
Apr 08 11:07:34 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-e61f4788-8ed5-4acc-b481-bdbae8aceeef-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-e61f4788-8ed5-4acc-b481-bdbae8aceeef-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8461a-9f36-443a-b791-cf61332f0ba1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:35 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.info" returned: 0 in 0.465s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.972s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:35 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef
Apr 08 11:07:35 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a60ac622-07a7-4700-8759-dac7c907f0a0 tempest-VolumesExtendTest-583003908 None] Create snapshot completed successfully
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2718ad89-1573-42d9-b179-fb170883e107]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:35 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:35 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:35 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef" returned: 0 in 0.738s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:36 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef
Apr 08 11:07:36 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:36 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.510s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b 2G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b 2G" returned: 0 in 0.070s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.601s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:INSERT=46,cinder:UPDATE=199,cinder:SELECT=152,cinder:DELETE=17 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:07:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dc527cf1-ce96-4163-a19e-90d61604736b tempest-VolumesExtendTest-583003908 None] Extend volume completed successfully.
Apr 08 11:07:36 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e61f4788-8ed5-4acc-b481-bdbae8aceeef" returned: 0 in 0.489s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-quobyte-e61f4788-8ed5-4acc-b481-bdbae8aceeef" released by "delete_volume" :: held 1.259s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Created reservations ['c267ced0-7525-4961-a3b8-063b679922fa', 'aaec66e9-6b03-452e-b7f6-c7f68572a1de', '1b52d5ef-e98f-4a09-b428-e335d1b99e4a', '4e8108c2-1b4f-45fd-8f2d-23c1dde64ab0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:36 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:36 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-e83735b4-e5b2-4d6d-aa4c-78e54b28705b-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-e83735b4-e5b2-4d6d-aa4c-78e54b28705b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-quobyte-e83735b4-e5b2-4d6d-aa4c-78e54b28705b" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-e83735b4-e5b2-4d6d-aa4c-78e54b28705b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Deleting offline snapshot e83735b4-e5b2-4d6d-aa4c-78e54b28705b of volume 4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] snapshot_file for this snap is: volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7a4540-a6b0-4537-ab10-7761213f4c5f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:37 devstack sudo[88786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b
Apr 08 11:07:37 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:37 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Deleted volume successfully.
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6701f2fa-255c-4acb-b5a2-1cbd03809333 tempest-VolumeDependencyTests-1319803059 None] Lock "cinder-e61f4788-8ed5-4acc-b481-bdbae8aceeef-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:37 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b" returned: 0 in 0.518s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a1ed335-8115-4361-b638-ad59d6f6b182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f3020d-a8e0-40dc-8026-1c22af23c6e1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:37 devstack sudo[88791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:37 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:38 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.574s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:38 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b
Apr 08 11:07:38 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:38 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:38 devstack sudo[88837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b
Apr 08 11:07:38 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:38 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182.e83735b4-e5b2-4d6d-aa4c-78e54b28705b" returned: 0 in 0.431s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-e83735b4-e5b2-4d6d-aa4c-78e54b28705b" released by "_delete_snapshot" :: held 2.075s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" released by "delete_snapshot" :: held 2.097s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Created reservations ['b2425736-170d-4cde-a03b-37d99e48bb66', 'd2f93ee1-694b-4384-a96a-1929a50f915a', '886dc391-641f-4a51-886c-c27f34a33493', '4690626a-aa83-4d57-bb49-9540343be90c'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Delete snapshot completed successfully.
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-310b906a-c419-4495-b0b3-af90d7c3d6fb tempest-VolumesExtendTest-583003908 None] Lock "cinder-e83735b4-e5b2-4d6d-aa4c-78e54b28705b-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Flow 'volume_create_manager' (cb8da477-0df7-4b7d-a3a0-f6bb843144e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c96260e-061f-4efb-8a63-2f882798ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c96260e-061f-4efb-8a63-2f882798ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c15d2-0da7-4ef4-8c28-00321e003db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3464c93b4fc47b89af19bcea250deea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:39Z,use_quota=True,user_id='2ef0c69f1fd24798aa9da7f064f4c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12bb766-124b-44c7-b885-d243c3995d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12bb766-124b-44c7-b885-d243c3995d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc271881-a640-49e2-8fe0-7fbf5ef0c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc271881-a640-49e2-8fe0-7fbf5ef0c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344c15d2-0da7-4ef4-8c28-00321e003db2', 'volume_name': 'volume-344c15d2-0da7-4ef4-8c28-00321e003db2', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4c3d90-3e08-4956-87c0-943e65783abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4c3d90-3e08-4956-87c0-943e65783abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ad5aa-3822-4374-8414-a7477fa30783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:39 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Volume 344c15d2-0da7-4ef4-8c28-00321e003db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344c15d2-0da7-4ef4-8c28-00321e003db2', 'volume_size': 1}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344c15d2-0da7-4ef4-8c28-00321e003db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3464c93b4fc47b89af19bcea250deea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:39Z,use_quota=True,user_id='2ef0c69f1fd24798aa9da7f064f4c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Creating volume 344c15d2-0da7-4ef4-8c28-00321e003db2 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:39 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:39 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 1073741824
Apr 08 11:07:39 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:39 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 1073741824" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:39 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2
Apr 08 11:07:39 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:40 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ad5aa-3822-4374-8414-a7477fa30783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344c15d2-0da7-4ef4-8c28-00321e003db2', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84110e53-30cb-43a3-b487-b66a80a030ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-4a1ed335-8115-4361-b638-ad59d6f6b182-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:40 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Volume volume-344c15d2-0da7-4ef4-8c28-00321e003db2 (344c15d2-0da7-4ef4-8c28-00321e003db2): created successfully
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84110e53-30cb-43a3-b487-b66a80a030ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Flow 'volume_create_manager' (cb8da477-0df7-4b7d-a3a0-f6bb843144e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "cinder-4a1ed335-8115-4361-b638-ad59d6f6b182-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:40 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2e5559ae-0db5-4f05-b6df-b20e510f4e43 tempest-CinderUnicodeTest-212791551 None] Created volume successfully.
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Acquiring lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4d898-c6ed-41c7-8703-2b455f6bd46e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:40 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:40 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:40 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.484s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:40 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182
Apr 08 11:07:40 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:41 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-4a1ed335-8115-4361-b638-ad59d6f6b182" returned: 0 in 0.403s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "cinder-quobyte-4a1ed335-8115-4361-b638-ad59d6f6b182" released by "delete_volume" :: held 0.913s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Created reservations ['c8bfa516-5392-44f0-aeaf-b120d3422991', '79420cbf-5d5e-4ca5-9909-0ad0be203935', '28f1abdd-2a66-4db0-a255-78133d37f254', '5919df57-c130-4b17-9519-2f66d4368781'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:41 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:41 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Flow 'volume_create_manager' (298a19f6-0f22-4e71-927b-5d6c717ddcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f8641c-3cab-4cd6-bd74-590abe20cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f8641c-3cab-4cd6-bd74-590abe20cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-468088425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35e9095-c4bc-4894-9cf8-ef98d666f1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3464c93b4fc47b89af19bcea250deea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:42Z,use_quota=True,user_id='2ef0c69f1fd24798aa9da7f064f4c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9446a-4c0e-44c9-b6b1-09bc5b0aa83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b9446a-4c0e-44c9-b6b1-09bc5b0aa83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea62f9b-c257-4ad0-aef8-ecf69d503683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea62f9b-c257-4ad0-aef8-ecf69d503683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35e9095-c4bc-4894-9cf8-ef98d666f1ef', 'volume_name': 'volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2108613-3506-4312-9c23-f791f657b589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2108613-3506-4312-9c23-f791f657b589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed46dea-0aaf-4545-93c0-2065657cc343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Volume a35e9095-c4bc-4894-9cf8-ef98d666f1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef', 'volume_size': 1}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-468088425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35e9095-c4bc-4894-9cf8-ef98d666f1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3464c93b4fc47b89af19bcea250deea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:42Z,use_quota=True,user_id='2ef0c69f1fd24798aa9da7f064f4c7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Creating volume a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:41 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:41 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.546s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Deleted volume successfully.
Apr 08 11:07:41 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef 1073741824
Apr 08 11:07:41 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d8971017-6bb2-46b4-b318-eee39b051816 tempest-VolumesExtendTest-583003908 None] Lock "cinder-4a1ed335-8115-4361-b638-ad59d6f6b182-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:42 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef 1073741824" returned: 0 in 0.584s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:42 devstack sudo[88865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef
Apr 08 11:07:42 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:42 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" returned: 0 in 0.511s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed46dea-0aaf-4545-93c0-2065657cc343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49c9b9a-dccd-4194-a91b-2afb2275ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Volume volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef (a35e9095-c4bc-4894-9cf8-ef98d666f1ef): created successfully
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d49c9b9a-dccd-4194-a91b-2afb2275ae46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Flow 'volume_create_manager' (298a19f6-0f22-4e71-927b-5d6c717ddcaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-269b159b-abba-431a-bb06-1005d2ba6384 tempest-CinderUnicodeTest-212791551 None] Created volume successfully.
Apr 08 11:07:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Creating offline snapshot bd2f1005-d1de-4247-9e18-da0a3457346e of volume a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:07:43 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71511e0-35f5-4fc7-8f55-0ce2e207aff2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:43 devstack sudo[88869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef
Apr 08 11:07:43 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:44 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" returned: 0 in 0.596s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:44 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e 1G
Apr 08 11:07:44 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Flow 'volume_create_manager' (33477e95-588d-4a9c-91e6-4beb363ba527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afafd4f6-2165-49b2-9981-0aee3c90b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afafd4f6-2165-49b2-9981-0aee3c90b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1456990486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99269e3-8780-44ed-b730-4ef9babbd5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a69c7e170641e0978081f757202f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:45Z,use_quota=True,user_id='0e7b657c9a5f40218759c2f701818c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11764bbb-2340-4b42-a8df-e8906ebae302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11764bbb-2340-4b42-a8df-e8906ebae302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac556da5-1204-44c9-87e5-320aba46e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac556da5-1204-44c9-87e5-320aba46e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a99269e3-8780-44ed-b730-4ef9babbd5d4', 'volume_name': 'volume-a99269e3-8780-44ed-b730-4ef9babbd5d4', 'volume_size': 2}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b92c91-94d1-405c-89ef-4b8f34149522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b92c91-94d1-405c-89ef-4b8f34149522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507e65f6-4c96-4be7-a4a6-2a7ad68f0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:44 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Volume a99269e3-8780-44ed-b730-4ef9babbd5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a99269e3-8780-44ed-b730-4ef9babbd5d4', 'volume_size': 2}
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:44 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e 1G" returned: 0 in 0.549s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:45 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e
Apr 08 11:07:45 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:45 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:45 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e is being set with open permissions: ugo+rw
Apr 08 11:07:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:45 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e
Apr 08 11:07:45 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:45 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e" returned: 0 in 0.460s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:45 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info
Apr 08 11:07:45 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:46 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info" returned: 0 in 0.454s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:46 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info is being set with open permissions: ugo+rw
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:46 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info
Apr 08 11:07:46 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:46 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.info" returned: 0 in 0.427s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1456990486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99269e3-8780-44ed-b730-4ef9babbd5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a69c7e170641e0978081f757202f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:45Z,use_quota=True,user_id='0e7b657c9a5f40218759c2f701818c00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Creating volume a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:46 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 2147483648 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:46 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 2147483648
Apr 08 11:07:46 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:46 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7d9aaafd-634e-4327-a9ec-65b6889d7132 tempest-CinderUnicodeTest-212791551 None] Create snapshot completed successfully
Apr 08 11:07:47 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 2147483648" returned: 0 in 0.517s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:47 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4
Apr 08 11:07:47 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:47 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4" returned: 0 in 0.423s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507e65f6-4c96-4be7-a4a6-2a7ad68f0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99269e3-8780-44ed-b730-4ef9babbd5d4', 'volume_size': 2}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d6d41-4f85-45cc-ab22-df54592ff9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:47 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Volume volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 (a99269e3-8780-44ed-b730-4ef9babbd5d4): created successfully
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d6d41-4f85-45cc-ab22-df54592ff9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Flow 'volume_create_manager' (33477e95-588d-4a9c-91e6-4beb363ba527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1fa1bf41-196a-455b-a46c-1e3d7a557568 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Created volume successfully.
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-bd2f1005-d1de-4247-9e18-da0a3457346e-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-bd2f1005-d1de-4247-9e18-da0a3457346e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-quobyte-bd2f1005-d1de-4247-9e18-da0a3457346e" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-bd2f1005-d1de-4247-9e18-da0a3457346e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Deleting offline snapshot bd2f1005-d1de-4247-9e18-da0a3457346e of volume a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] snapshot_file for this snap is: volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec2e455-e3e9-4285-a9d1-d5ff3ed3d77e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:48 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e
Apr 08 11:07:48 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:48 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e" returned: 0 in 0.482s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[032739bb-f167-44e9-a2bd-619591eb1fde]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:48 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef
Apr 08 11:07:48 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Creating offline snapshot 30f63b54-cbd4-456d-8875-11f7b8f3eee9 of volume a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e41007e-7f4d-4bee-8f1a-35354fec1091]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:49 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" returned: 0 in 0.605s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:49 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e
Apr 08 11:07:49 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:49 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4
Apr 08 11:07:49 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:49 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:49 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4" returned: 0 in 0.513s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 2G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:49 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e
Apr 08 11:07:49 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:49 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 2G
Apr 08 11:07:49 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:50 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef.bd2f1005-d1de-4247-9e18-da0a3457346e" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-bd2f1005-d1de-4247-9e18-da0a3457346e" released by "_delete_snapshot" :: held 2.028s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" released by "delete_snapshot" :: held 2.054s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:50 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 2G" returned: 0 in 0.499s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Created reservations ['7119a1f8-456e-42bf-b6f6-7782f61f61e1', 'b84ef99a-2df3-40a6-9540-25959e059eb5', 'c8a00706-526c-4ff2-9603-b92e579b83d3', '8df963ac-e8d3-4fd9-8bb2-5d4b47e2bf04'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:50 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9
Apr 08 11:07:50 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:50 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Delete snapshot completed successfully.
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68bc90b7-5f00-43ca-a7c6-25c959903d5d tempest-CinderUnicodeTest-212791551 None] Lock "cinder-bd2f1005-d1de-4247-9e18-da0a3457346e-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:50 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9" returned: 0 in 0.512s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:50 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 is being set with open permissions: ugo+rw
Apr 08 11:07:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:50 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9
Apr 08 11:07:50 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:51 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9" returned: 0 in 0.425s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:51 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info
Apr 08 11:07:51 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-a35e9095-c4bc-4894-9cf8-ef98d666f1ef-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-a35e9095-c4bc-4894-9cf8-ef98d666f1ef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c148071-234b-40c0-8c1d-2bb2b335ab4e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:51 devstack sudo[88941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef
Apr 08 11:07:51 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:51 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:51 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info is being set with open permissions: ugo+rw
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:51 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info
Apr 08 11:07:51 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:51 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:51 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef
Apr 08 11:07:51 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:52 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.info" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.937s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1fab60eb-f538-4e2f-b8a5-4b3ca8a47725 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Create snapshot completed successfully
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "cinder-30f63b54-cbd4-456d-8875-11f7b8f3eee9-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-30f63b54-cbd4-456d-8875-11f7b8f3eee9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "cinder-quobyte-30f63b54-cbd4-456d-8875-11f7b8f3eee9" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-30f63b54-cbd4-456d-8875-11f7b8f3eee9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Deleting offline snapshot 30f63b54-cbd4-456d-8875-11f7b8f3eee9 of volume a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:07:52 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] snapshot_file for this snap is: volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" returned: 0 in 0.541s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d569753-4748-4282-88e4-351d45be4a2d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-a35e9095-c4bc-4894-9cf8-ef98d666f1ef" released by "delete_volume" :: held 1.121s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Created reservations ['7f4d4b80-f83d-48e5-96e4-36789b86b382', '5ff037d5-77b2-4a86-8eaf-d42f3e2600d0', '2a93d81c-016e-4bf5-bfcb-450f5a3fe52f', 'bfb2f0e0-03d2-4f79-8337-0a899af7acab'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:52 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9
Apr 08 11:07:52 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:52 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:52 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:52 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9" returned: 0 in 0.549s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a99269e3-8780-44ed-b730-4ef9babbd5d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fd1a1f-5731-410c-8cb6-e0463205aeae]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:52 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:52 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Deleted volume successfully.
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-38df22ff-69d4-4bb9-8df0-c7e6371d7909 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-a35e9095-c4bc-4894-9cf8-ef98d666f1ef-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:53 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4
Apr 08 11:07:53 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-344c15d2-0da7-4ef4-8c28-00321e003db2-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-344c15d2-0da7-4ef4-8c28-00321e003db2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "cinder-quobyte-344c15d2-0da7-4ef4-8c28-00321e003db2" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-344c15d2-0da7-4ef4-8c28-00321e003db2" acquired by "delete_volume" :: waited 0.018s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bcfbd6-409f-4b84-8d52-b6a565c15e47]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:53 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4" returned: 0 in 0.568s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:53 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9
Apr 08 11:07:53 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:53 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2
Apr 08 11:07:53 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:54 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:54 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2" returned: 0 in 0.523s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:54 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9
Apr 08 11:07:54 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:54 devstack sudo[88979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2
Apr 08 11:07:54 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:54 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4.30f63b54-cbd4-456d-8875-11f7b8f3eee9" returned: 0 in 0.448s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:54 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-30f63b54-cbd4-456d-8875-11f7b8f3eee9" released by "_delete_snapshot" :: held 2.144s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-344c15d2-0da7-4ef4-8c28-00321e003db2" returned: 0 in 0.458s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" released by "delete_snapshot" :: held 2.174s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-quobyte-344c15d2-0da7-4ef4-8c28-00321e003db2" released by "delete_volume" :: held 1.031s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Created reservations ['18606751-13b8-4798-8d5f-145163510403', '1619c806-57a3-4ec0-aac9-0e9690decb7e', '994547d4-9f0f-497c-881d-6149142d0b3f', '599ac04c-c76b-46b3-abef-4421fb5bd7ee'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Created reservations ['0b1f8500-9d8e-435a-b444-1eecc9dc7cbb', '363be259-9bdf-45f2-88b2-7c1bfae5daff', '6075a546-2609-4987-9eff-15daf1bea6d6', 'bafcd475-bf9d-4c05-955b-4a52b83028df'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:54 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:54 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Delete snapshot completed successfully.
Apr 08 11:07:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1c5b25cc-3e88-4f1b-8bf4-8a001771dd13 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-30f63b54-cbd4-456d-8875-11f7b8f3eee9-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:55 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Deleted volume successfully.
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-694cf9e0-af6e-4311-9b8a-91a1940e7d56 tempest-CinderUnicodeTest-212791551 None] Lock "cinder-344c15d2-0da7-4ef4-8c28-00321e003db2-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "cinder-a99269e3-8780-44ed-b730-4ef9babbd5d4-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-a99269e3-8780-44ed-b730-4ef9babbd5d4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3ad54f-6743-4848-ba48-4fb68f717261]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:07:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:55 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4
Apr 08 11:07:55 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:56 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4" returned: 0 in 0.541s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:56 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4
Apr 08 11:07:56 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:56 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a99269e3-8780-44ed-b730-4ef9babbd5d4" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-quobyte-a99269e3-8780-44ed-b730-4ef9babbd5d4" released by "delete_volume" :: held 1.064s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Created reservations ['d701e0f9-6389-43a2-bb35-28df646b9d20', '26f3639c-920b-422b-9999-9e23c94e4e5d', '31ea8af4-ea13-457f-b69b-336591955a50', 'efe1ee79-b347-4720-ba64-6dd472d462b2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:56 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:07:56 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:07:57 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Apr 08 11:07:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:07:57 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:07:57 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Deleted volume successfully.
Apr 08 11:07:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ee3db79e-0ee5-4b23-9a8e-407e44edd654 tempest-VolumesSnapshotNegativeTestJSON-1587839511 None] Lock "cinder-a99269e3-8780-44ed-b730-4ef9babbd5d4-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (9d77605f-ddc8-4dd3-b566-7dff7de2a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db5cb9-b8bb-4a25-800d-340fc4e8c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db5cb9-b8bb-4a25-800d-340fc4e8c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821296162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8357baf-4f92-4e1e-b2d8-17488e405128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:59Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495cb5e2-b190-4438-bc6d-0a6da689f53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (495cb5e2-b190-4438-bc6d-0a6da689f53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf3ace4-1f3b-4450-82f2-6dc4723cb464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf3ace4-1f3b-4450-82f2-6dc4723cb464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8357baf-4f92-4e1e-b2d8-17488e405128', 'volume_name': 'volume-b8357baf-4f92-4e1e-b2d8-17488e405128', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7854a8bb-035e-4f1c-bd60-94b15e68ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7854a8bb-035e-4f1c-bd60-94b15e68ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e7d2c9-9412-4bc5-81b1-0e731bcbf7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:07:59 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume b8357baf-4f92-4e1e-b2d8-17488e405128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8357baf-4f92-4e1e-b2d8-17488e405128', 'volume_size': 1}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-821296162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8357baf-4f92-4e1e-b2d8-17488e405128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:07:59Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume b8357baf-4f92-4e1e-b2d8-17488e405128 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:07:59 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:07:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:07:59 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 1073741824
Apr 08 11:07:59 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:00 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 1073741824" returned: 0 in 0.556s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:00 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128
Apr 08 11:08:00 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:00 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128" returned: 0 in 0.522s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e7d2c9-9412-4bc5-81b1-0e731bcbf7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8357baf-4f92-4e1e-b2d8-17488e405128', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a52959-7ebe-476f-81d2-e8af94eb28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:00 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-b8357baf-4f92-4e1e-b2d8-17488e405128 (b8357baf-4f92-4e1e-b2d8-17488e405128): created successfully
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a52959-7ebe-476f-81d2-e8af94eb28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (9d77605f-ddc8-4dd3-b566-7dff7de2a842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:00 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-bd56181e-eb96-49d5-a16c-fbbb983adde1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (fc55df11-2612-4178-be84-ae8888cf5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8caaa0f-5eee-40a5-b407-5cf0b4e8aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8caaa0f-5eee-40a5-b407-5cf0b4e8aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209967616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f44b80-f809-4aa1-9d60-2ce4154cf17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a038e-7b32-488d-a67c-ccd5731f9e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168a038e-7b32-488d-a67c-ccd5731f9e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9846fce8-4285-47cd-a2c9-9e3c5b7d1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9846fce8-4285-47cd-a2c9-9e3c5b7d1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f44b80-f809-4aa1-9d60-2ce4154cf17d', 'volume_name': 'volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e98f270-4610-43c4-869a-9159485fb962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e98f270-4610-43c4-869a-9159485fb962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37120731-1197-4143-9069-45ccf5414bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume 00f44b80-f809-4aa1-9d60-2ce4154cf17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d', 'volume_size': 1}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209967616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f44b80-f809-4aa1-9d60-2ce4154cf17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume 00f44b80-f809-4aa1-9d60-2ce4154cf17d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:01 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:01 devstack sudo[89027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d 1073741824
Apr 08 11:08:01 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (9fe06dfd-205b-493f-b905-34a3c133b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c51cd3b-f119-4529-8cb3-5080a0148e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c51cd3b-f119-4529-8cb3-5080a0148e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681824032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d4c551-1f2e-4c3e-8821-cbcae778b27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744fbf7e-afbc-49ac-924c-3f46f3f88b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (744fbf7e-afbc-49ac-924c-3f46f3f88b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e64b966-c70a-457c-938e-4e0e6d85de40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e64b966-c70a-457c-938e-4e0e6d85de40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d4c551-1f2e-4c3e-8821-cbcae778b27d', 'volume_name': 'volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8154eb6-0648-4e35-a37e-d597f65145e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8154eb6-0648-4e35-a37e-d597f65145e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a073f-63c5-4fe1-a9d4-d3dece54356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume 41d4c551-1f2e-4c3e-8821-cbcae778b27d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d', 'volume_size': 1}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (f80d5eb3-53cc-451f-9c7d-3415567f7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee460269-8d66-420d-9ffe-bcab0ba2524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee460269-8d66-420d-9ffe-bcab0ba2524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685366778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f95341-141b-4a0a-b62d-39327482f7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3208c247-903b-4f20-a2d7-3e6bb9c67f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3208c247-903b-4f20-a2d7-3e6bb9c67f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e405f079-0f6c-47c9-b9fe-289b8e28fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e405f079-0f6c-47c9-b9fe-289b8e28fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f95341-141b-4a0a-b62d-39327482f7f9', 'volume_name': 'volume-03f95341-141b-4a0a-b62d-39327482f7f9', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1e1d67-c914-4ada-932b-bce7f233be96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1e1d67-c914-4ada-932b-bce7f233be96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7d9bdf-40d1-44a1-9d52-a12234e89183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume 03f95341-141b-4a0a-b62d-39327482f7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f95341-141b-4a0a-b62d-39327482f7f9', 'volume_size': 1}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (b18ed4e5-6be5-4ebd-a088-c2d3c8e4bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439df640-290b-40b5-841e-53d3d14df2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439df640-290b-40b5-841e-53d3d14df2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243931501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2625b0cf-76d8-4725-999c-4df51314059c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae056183-8769-420c-943c-28fb37bee8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae056183-8769-420c-943c-28fb37bee8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9cd245-9a23-4294-ab1e-60fc55ca78a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9cd245-9a23-4294-ab1e-60fc55ca78a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2625b0cf-76d8-4725-999c-4df51314059c', 'volume_name': 'volume-2625b0cf-76d8-4725-999c-4df51314059c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36656a-ad3e-4fcc-b15d-2185785b5760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36656a-ad3e-4fcc-b15d-2185785b5760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6add6d6b-394f-4604-be96-a8d4f2be35c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:02 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume 2625b0cf-76d8-4725-999c-4df51314059c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2625b0cf-76d8-4725-999c-4df51314059c', 'volume_size': 1}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d 1073741824" returned: 0 in 0.714s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:02 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:02 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:02 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d
Apr 08 11:08:02 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (7c84e9a6-d504-410e-a29c-f2a895e1159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfddc9a-dc88-4e3e-b8b1-012735adc104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edfddc9a-dc88-4e3e-b8b1-012735adc104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132154487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a65e2b8-4957-4efc-b69a-8f380e86b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:03Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd78a10-0920-40f3-9002-27c5296ff584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd78a10-0920-40f3-9002-27c5296ff584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46858ca-04be-46a7-901e-a7f974c5dc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46858ca-04be-46a7-901e-a7f974c5dc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a65e2b8-4957-4efc-b69a-8f380e86b897', 'volume_name': 'volume-6a65e2b8-4957-4efc-b69a-8f380e86b897', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c23f5a4-70ae-4469-9194-cbc701ddb8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c23f5a4-70ae-4469-9194-cbc701ddb8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055123f-614a-4e0e-80a4-1fcc2a69ff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:02 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume 6a65e2b8-4957-4efc-b69a-8f380e86b897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a65e2b8-4957-4efc-b69a-8f380e86b897', 'volume_size': 1}
Apr 08 11:08:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:03 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d" returned: 0 in 0.565s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.089s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681824032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d4c551-1f2e-4c3e-8821-cbcae778b27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume 41d4c551-1f2e-4c3e-8821-cbcae778b27d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:03 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:03 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37120731-1197-4143-9069-45ccf5414bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1259e-11db-4c24-bcfb-e2b403ef4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:03 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d 1073741824
Apr 08 11:08:03 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:03 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d (00f44b80-f809-4aa1-9d60-2ce4154cf17d): created successfully
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda1259e-11db-4c24-bcfb-e2b403ef4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (fc55df11-2612-4178-be84-ae8888cf5933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.667s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:03 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e50e708b-96b5-4e70-a875-091247286e5e tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:03 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d 1073741824" returned: 0 in 0.505s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:03 devstack sudo[89043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d
Apr 08 11:08:03 devstack sudo[89043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:04 devstack sudo[89043]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d" returned: 0 in 0.603s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685366778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f95341-141b-4a0a-b62d-39327482f7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume 03f95341-141b-4a0a-b62d-39327482f7f9 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:04 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879a073f-63c5-4fe1-a9d4-d3dece54356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:04 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 1073741824
Apr 08 11:08:04 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee4de9-27b8-4b06-b4d3-137d0515ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:04 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d (41d4c551-1f2e-4c3e-8821-cbcae778b27d): created successfully
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ee4de9-27b8-4b06-b4d3-137d0515ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (9fe06dfd-205b-493f-b905-34a3c133b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-effbe436-f310-4f4c-b6aa-c05ceda6f8a1 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:04 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 1073741824" returned: 0 in 0.534s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:04 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9
Apr 08 11:08:04 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:05 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9" returned: 0 in 0.488s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.812s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243931501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2625b0cf-76d8-4725-999c-4df51314059c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:02Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume 2625b0cf-76d8-4725-999c-4df51314059c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:05 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7d9bdf-40d1-44a1-9d52-a12234e89183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f95341-141b-4a0a-b62d-39327482f7f9', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890e7036-520c-41bd-af21-3579bb12acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:05 devstack sudo[89057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c 1073741824
Apr 08 11:08:05 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:05 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-03f95341-141b-4a0a-b62d-39327482f7f9 (03f95341-141b-4a0a-b62d-39327482f7f9): created successfully
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890e7036-520c-41bd-af21-3579bb12acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (f80d5eb3-53cc-451f-9c7d-3415567f7b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d4e112ea-a1fa-4a3e-8ad4-c6c43d8a7403 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:05 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c 1073741824" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:06 devstack sudo[89087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c
Apr 08 11:08:06 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:06 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c" returned: 0 in 0.520s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.538s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132154487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a65e2b8-4957-4efc-b69a-8f380e86b897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee8ba12cd474cceb5d21f90212b272a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:03Z,use_quota=True,user_id='7ffb0a5f5919477dbce6533d8c58136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Creating volume 6a65e2b8-4957-4efc-b69a-8f380e86b897 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:06 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6add6d6b-394f-4604-be96-a8d4f2be35c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2625b0cf-76d8-4725-999c-4df51314059c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:06 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 1073741824
Apr 08 11:08:06 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896ab0f0-19a3-4334-80a1-bc7e6c063bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:06 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-2625b0cf-76d8-4725-999c-4df51314059c (2625b0cf-76d8-4725-999c-4df51314059c): created successfully
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896ab0f0-19a3-4334-80a1-bc7e6c063bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (b18ed4e5-6be5-4ebd-a088-c2d3c8e4bdac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-20efd2cd-227a-4b30-81ee-82064d439662 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:07 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 1073741824" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:07 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897
Apr 08 11:08:07 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:07 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f055123f-614a-4e0e-80a4-1fcc2a69ff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a65e2b8-4957-4efc-b69a-8f380e86b897', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d13a08-7e63-4c8d-a559-98e82dcf0904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:07 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Volume volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 (6a65e2b8-4957-4efc-b69a-8f380e86b897): created successfully
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d13a08-7e63-4c8d-a559-98e82dcf0904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Flow 'volume_create_manager' (7c84e9a6-d504-410e-a29c-f2a895e1159f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-da0d5f50-646c-40c4-a640-63d903ae8cf2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created volume successfully.
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-6a65e2b8-4957-4efc-b69a-8f380e86b897-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-6a65e2b8-4957-4efc-b69a-8f380e86b897-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-6a65e2b8-4957-4efc-b69a-8f380e86b897" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-6a65e2b8-4957-4efc-b69a-8f380e86b897" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa33eb-ce52-452f-9d3b-578377a07fd6]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:08 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897
Apr 08 11:08:08 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:09 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897" returned: 0 in 0.560s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:09 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897
Apr 08 11:08:09 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:09 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a65e2b8-4957-4efc-b69a-8f380e86b897" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-6a65e2b8-4957-4efc-b69a-8f380e86b897" released by "delete_volume" :: held 1.058s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['95e432fd-877c-4cda-947f-9662aa68ec2f', '86814c84-22bb-4b01-9c9c-5ba731b847e0', '4ad51d03-7d5e-4619-9fe5-97eca6579303', '832f005f-793c-46af-a07c-22681576a672'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:09 devstack sudo[89106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:09 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:10 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.518s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-73fe93ab-4380-4140-96fa-dab348f7b0b2 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-6a65e2b8-4957-4efc-b69a-8f380e86b897-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-2625b0cf-76d8-4725-999c-4df51314059c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-2625b0cf-76d8-4725-999c-4df51314059c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-2625b0cf-76d8-4725-999c-4df51314059c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-2625b0cf-76d8-4725-999c-4df51314059c" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a553cfa9-9175-4875-9ca7-b69bc63db74c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:10 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c
Apr 08 11:08:10 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:11 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c" returned: 0 in 0.540s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:11 devstack sudo[89117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c
Apr 08 11:08:11 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:11 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2625b0cf-76d8-4725-999c-4df51314059c" returned: 0 in 0.637s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-2625b0cf-76d8-4725-999c-4df51314059c" released by "delete_volume" :: held 1.226s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['dca540b8-0fd0-4f6a-bd43-2e8887958195', 'a6623b01-a275-47f0-8bdf-1c02156ada35', 'e91c9b9e-33d0-40d1-95be-7fb8f857114d', '7c013c81-2fd0-4dba-94c7-bb6270419452'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:11 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:11 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:12 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-afd74cf4-b19a-4f55-bf50-5c61ea87abc5 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-2625b0cf-76d8-4725-999c-4df51314059c-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-03f95341-141b-4a0a-b62d-39327482f7f9-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-03f95341-141b-4a0a-b62d-39327482f7f9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-03f95341-141b-4a0a-b62d-39327482f7f9" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-03f95341-141b-4a0a-b62d-39327482f7f9" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa0beb-a76b-4c84-86d9-7cedea9b5bd0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:13 devstack sudo[89125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9
Apr 08 11:08:13 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:13 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Flow 'volume_create_manager' (f187429c-6818-43f5-8903-e84e22db5ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d220e96e-c304-4a7a-b2a3-a04bde16fd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9" returned: 0 in 0.701s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d220e96e-c304-4a7a-b2a3-a04bde16fd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1766584917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e50a9-29c7-4639-9909-281a1ad479dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b12daf23e664bd9a9b66f5e4ab501eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:14Z,use_quota=True,user_id='4edac4a400574042afeced89dd8f9210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:13 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9
Apr 08 11:08:13 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a338208-ee04-4a7b-81ff-b5d36f34350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a338208-ee04-4a7b-81ff-b5d36f34350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77e55d7-ba86-4ff1-8418-e09a6f90933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77e55d7-ba86-4ff1-8418-e09a6f90933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98e50a9-29c7-4639-9909-281a1ad479dc', 'volume_name': 'volume-b98e50a9-29c7-4639-9909-281a1ad479dc', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1475f8f6-8b9e-439a-b071-0aa591d8bd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1475f8f6-8b9e-439a-b071-0aa591d8bd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9f123f-fe53-456e-86c0-6453efb9fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:13 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Volume b98e50a9-29c7-4639-9909-281a1ad479dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98e50a9-29c7-4639-9909-281a1ad479dc', 'volume_size': 1}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1766584917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98e50a9-29c7-4639-9909-281a1ad479dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b12daf23e664bd9a9b66f5e4ab501eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:14Z,use_quota=True,user_id='4edac4a400574042afeced89dd8f9210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Creating volume b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:13 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:13 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc 1073741824
Apr 08 11:08:13 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:14 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-03f95341-141b-4a0a-b62d-39327482f7f9" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-03f95341-141b-4a0a-b62d-39327482f7f9" released by "delete_volume" :: held 1.200s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['26daeea0-78e9-481c-9806-4d48fed4673a', '0d5515f8-0229-4aac-94ef-d4a132f2d282', 'b9ebc6ed-08f9-49b1-a03f-593c2f70a034', '0cfc9aeb-0b10-4f8c-9658-503e9cf1da40'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:14 devstack sudo[89143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:14 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:14 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc 1073741824" returned: 0 in 0.629s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:14 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:14 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:14 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.435s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-6e9e2058-bc0f-4bf6-b0c9-7b1ccd749b27 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-03f95341-141b-4a0a-b62d-39327482f7f9-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:14 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9f123f-fe53-456e-86c0-6453efb9fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98e50a9-29c7-4639-9909-281a1ad479dc', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80dd563-70e5-4828-a8dd-2cec720cb87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:14 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Volume volume-b98e50a9-29c7-4639-9909-281a1ad479dc (b98e50a9-29c7-4639-9909-281a1ad479dc): created successfully
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f80dd563-70e5-4828-a8dd-2cec720cb87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Flow 'volume_create_manager' (f187429c-6818-43f5-8903-e84e22db5ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-433ac616-44dc-4cf7-8c9e-71ef63ff3688 tempest-SnapshotDependencyTests-1206345164 None] Created volume successfully.
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-41d4c551-1f2e-4c3e-8821-cbcae778b27d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-41d4c551-1f2e-4c3e-8821-cbcae778b27d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-41d4c551-1f2e-4c3e-8821-cbcae778b27d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-41d4c551-1f2e-4c3e-8821-cbcae778b27d" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee0cde-ef81-46a6-a771-b2a4dfb22ee0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:15 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d
Apr 08 11:08:15 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:15 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:15 devstack sudo[89154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d
Apr 08 11:08:15 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Creating offline snapshot 6bb067ab-f4c5-42fc-b378-1033564af68e of volume b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79cc165-019d-47a7-a1e7-02a5531decf5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:16 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:16 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:16 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-41d4c551-1f2e-4c3e-8821-cbcae778b27d" returned: 0 in 0.488s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-41d4c551-1f2e-4c3e-8821-cbcae778b27d" released by "delete_volume" :: held 1.027s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['9ed8277d-edf7-4827-a579-4293cb019ff2', '82df4b46-91a4-4573-aebb-288938f28bb1', 'd4c3ea9e-6b00-4da6-a7c3-b1b1a5c7fc9b', 'de39af82-bed5-45f0-a183-8e88ad215184'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:16 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:16 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:16 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:16 devstack sudo[89165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e 1G
Apr 08 11:08:16 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:16 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b40876e1-889f-4f5e-89fe-26c8c8d38f20 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-41d4c551-1f2e-4c3e-8821-cbcae778b27d-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:17 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e 1G" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e50a9-29c7-4639-9909-281a1ad479dc -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:17 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e50a9-29c7-4639-9909-281a1ad479dc -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:17 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-00f44b80-f809-4aa1-9d60-2ce4154cf17d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-00f44b80-f809-4aa1-9d60-2ce4154cf17d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-00f44b80-f809-4aa1-9d60-2ce4154cf17d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-00f44b80-f809-4aa1-9d60-2ce4154cf17d" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0b678f-eff7-47f2-9c5c-9a024b6cee93]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:17 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d
Apr 08 11:08:17 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:17 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b98e50a9-29c7-4639-9909-281a1ad479dc -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.482s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:17 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e is being set with open permissions: ugo+rw
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:17 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:17 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:17 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:17 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d
Apr 08 11:08:17 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:18 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.525s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:18 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info
Apr 08 11:08:18 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:18 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-00f44b80-f809-4aa1-9d60-2ce4154cf17d" returned: 0 in 0.585s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-00f44b80-f809-4aa1-9d60-2ce4154cf17d" released by "delete_volume" :: held 1.149s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['3c88be0d-33bb-4096-8e25-4e90425bc0b6', 'dd824d7f-5bac-4b60-accc-221a1826fe75', 'e883e7fe-b8d6-4494-b6e1-fcf53ec3d58d', '25a8bcd5-a1cb-441b-a4ed-56e804988f54'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:18 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:18 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:18 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:18 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info is being set with open permissions: ugo+rw
Apr 08 11:08:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:18 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info
Apr 08 11:08:18 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:19 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.486s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:19 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1eb10f58-57ee-4136-a65c-a99109c9619b tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-00f44b80-f809-4aa1-9d60-2ce4154cf17d-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:19 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.info" returned: 0 in 0.589s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.243s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:19 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-212988d7-d679-4eac-bd00-a5a5da3828d7 tempest-SnapshotDependencyTests-1206345164 None] Create snapshot completed successfully
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-b8357baf-4f92-4e1e-b2d8-17488e405128-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-b8357baf-4f92-4e1e-b2d8-17488e405128-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "cinder-quobyte-b8357baf-4f92-4e1e-b2d8-17488e405128" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-b8357baf-4f92-4e1e-b2d8-17488e405128" acquired by "delete_volume" :: waited 0.021s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bccdcf5-32f4-4a0d-a49f-5ff629871777]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:19 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128
Apr 08 11:08:19 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:20 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128" returned: 0 in 0.515s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:20 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128
Apr 08 11:08:20 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:20 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b8357baf-4f92-4e1e-b2d8-17488e405128" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Flow 'volume_create_manager' (56368b2f-5f88-40c9-85f4-214a849e190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5625ba1-daa6-4fc5-8911-29513d265af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-quobyte-b8357baf-4f92-4e1e-b2d8-17488e405128" released by "delete_volume" :: held 1.137s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5625ba1-daa6-4fc5-8911-29513d265af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74fc00bf-b9d8-41a1-8f9b-17c818eef974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b12daf23e664bd9a9b66f5e4ab501eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6bb067ab-f4c5-42fc-b378-1033564af68e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:21Z,use_quota=True,user_id='4edac4a400574042afeced89dd8f9210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2a5402-6136-4a5c-91b0-1446650f038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2a5402-6136-4a5c-91b0-1446650f038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5438ea-7dbe-4a86-b58f-bca51cd846e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da5438ea-7dbe-4a86-b58f-bca51cd846e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74fc00bf-b9d8-41a1-8f9b-17c818eef974', 'volume_name': 'volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974', 'volume_size': 1, 'snapshot_id': '6bb067ab-f4c5-42fc-b378-1033564af68e'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f50b6d-04d9-470e-917a-e9964999f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f50b6d-04d9-470e-917a-e9964999f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b996d8e-693f-43dc-8052-995734fbcd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Volume 74fc00bf-b9d8-41a1-8f9b-17c818eef974: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974', 'volume_size': 1, 'snapshot_id': '6bb067ab-f4c5-42fc-b378-1033564af68e'}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e-74fc00bf-b9d8-41a1-8f9b-17c818eef974" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e-74fc00bf-b9d8-41a1-8f9b-17c818eef974" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Creating volume 74fc00bf-b9d8-41a1-8f9b-17c818eef974 from snapshot 6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] snapshot: 6bb067ab-f4c5-42fc-b378-1033564af68e, volume: 74fc00bf-b9d8-41a1-8f9b-17c818eef974,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5683dc-df99-4d42-8954-d64cb0ff8311]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Created reservations ['a3a1c8e7-15bb-488e-8c96-2d385c866167', 'fa25e226-a6cf-4a8b-8e70-d4af1cde516a', '51f26897-9c98-4799-8daa-e2d560d893dc', 'b6566368-8b46-4969-9831-af510008b5cd'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:20 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:20 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:20 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:20 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:21 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.445s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Deleted volume successfully.
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ad1a8297-dc75-47ce-b6a9-686fc1618765 tempest-CreateVolumesFromSourceVolumeTest-236022012 None] Lock "cinder-b8357baf-4f92-4e1e-b2d8-17488e405128-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:21 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.554s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98e50a9-29c7-4639-9909-281a1ad479dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1579dcf-5dcd-40f0-89f4-495a85c5ce3b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:21 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:21 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:21 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.549s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:08:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:21 devstack sudo[89233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974
Apr 08 11:08:21 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:24 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974" returned: 0 in 2.792s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bcf15b-2edc-4b0e-a3e9-d962ba2d50b8]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:24 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:24 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:25 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.669s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc, size 1024.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:08:25 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Converted 1024.00 MB image at 366.66 MB/s
Apr 08 11:08:25 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 is being set with open permissions: ugo+rw
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:25 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974
Apr 08 11:08:25 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:25 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974" returned: 0 in 0.391s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" released by "_copy_volume_from_snapshot" :: held 5.029s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e-74fc00bf-b9d8-41a1-8f9b-17c818eef974" released by "_create_volume_from_snapshot" :: held 5.051s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.062s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b996d8e-693f-43dc-8052-995734fbcd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974', 'volume_size': 1, 'snapshot_id': '6bb067ab-f4c5-42fc-b378-1033564af68e'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f45025-3bd7-400e-9f33-0ddfb5094b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:25 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Volume volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 (74fc00bf-b9d8-41a1-8f9b-17c818eef974): created successfully
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f45025-3bd7-400e-9f33-0ddfb5094b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:25 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Flow 'volume_create_manager' (56368b2f-5f88-40c9-85f4-214a849e190f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-491fe252-86ab-487b-96d1-e1ca7923349c tempest-SnapshotDependencyTests-1206345164 None] Created volume successfully.
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-6bb067ab-f4c5-42fc-b378-1033564af68e-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-6bb067ab-f4c5-42fc-b378-1033564af68e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Deleting offline snapshot 6bb067ab-f4c5-42fc-b378-1033564af68e of volume b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] snapshot_file for this snap is: volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec6daf8-7f11-4052-9c2d-1831dd06dd20]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:26 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:26 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:26 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.516s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b98e50a9-29c7-4639-9909-281a1ad479dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384e101-3285-43eb-92d0-323f482ff5fc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:26 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:26 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:27 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.559s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:27 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:27 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:27 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.514s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:27 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e
Apr 08 11:08:27 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:28 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc.6bb067ab-f4c5-42fc-b378-1033564af68e" returned: 0 in 0.427s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-6bb067ab-f4c5-42fc-b378-1033564af68e" released by "_delete_snapshot" :: held 2.083s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" released by "delete_snapshot" :: held 2.096s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:28 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Created reservations ['99f91715-c289-454c-b381-8c9548427edd', '4edee5ab-3375-4102-a8c0-1a4c3170430f', '9f9f51c4-4272-447a-9173-795bd29c1606', 'daa0d347-93fb-430a-b39d-3ad24146198f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Delete snapshot completed successfully.
Apr 08 11:08:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-eb7eb2c6-ea65-46ce-8b1a-657c094afcd3 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-6bb067ab-f4c5-42fc-b378-1033564af68e-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-b98e50a9-29c7-4639-9909-281a1ad479dc-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-b98e50a9-29c7-4639-9909-281a1ad479dc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da4e66-2726-4ff3-9164-008a000d7dd9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:29 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:29 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:29 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.522s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:29 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc
Apr 08 11:08:29 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:30 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b98e50a9-29c7-4639-9909-281a1ad479dc" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-b98e50a9-29c7-4639-9909-281a1ad479dc" released by "delete_volume" :: held 1.033s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Created reservations ['e729f68f-fea5-4dfc-8fbb-09709de22c0e', '787e1b81-2c7e-40e7-9f26-a39af29fa6af', '0fad4dde-9e95-45b1-a2e8-74e6373be0b7', '348e347c-d593-4c37-9736-182b55703942'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:30 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:30 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:30 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.407s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Deleted volume successfully.
Apr 08 11:08:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c966348a-400b-4ef8-82e8-d68542d30fd1 tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-b98e50a9-29c7-4639-9909-281a1ad479dc-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-74fc00bf-b9d8-41a1-8f9b-17c818eef974-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-74fc00bf-b9d8-41a1-8f9b-17c818eef974-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a8da9-3b0b-4eab-96d9-ccb236dbdc43]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:31 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974
Apr 08 11:08:31 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:31 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974" returned: 0 in 0.486s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:32 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974
Apr 08 11:08:32 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:32 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-74fc00bf-b9d8-41a1-8f9b-17c818eef974" returned: 0 in 0.424s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-quobyte-74fc00bf-b9d8-41a1-8f9b-17c818eef974" released by "delete_volume" :: held 0.954s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Created reservations ['38916f96-b0af-4d09-8b69-96955d087ab7', '3bbb60e7-2bdd-474e-857f-ce4fb0213e49', '0b9162f1-f920-4717-86ed-a628ba708f40', 'da2c5584-fa02-4dd9-8656-3c995915a42f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:32 devstack sudo[89362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:32 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:32 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:33 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Deleted volume successfully.
Apr 08 11:08:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4e8eaff6-42b7-4677-be07-b24f66f1fabe tempest-SnapshotDependencyTests-1206345164 None] Lock "cinder-74fc00bf-b9d8-41a1-8f9b-17c818eef974-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=130,cinder:INSERT=43,cinder:UPDATE=173,cinder:DELETE=14 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Flow 'volume_create_manager' (7fd478a7-b76c-41d8-ba77-8f75c4f0062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d594ecd-06d4-4144-92c4-6c1a6780746d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d594ecd-06d4-4144-92c4-6c1a6780746d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-958585783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543c84fd-a2c3-4941-bec2-bfcf29c3951a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a94aaf277e0458284c913639d7c8b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:35Z,use_quota=True,user_id='cce6fcb564a74171b12858b1dc2af8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c606db72-d160-4b3a-afc7-ca941e193d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c606db72-d160-4b3a-afc7-ca941e193d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2970799-de61-4322-b278-e92333f89a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2970799-de61-4322-b278-e92333f89a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543c84fd-a2c3-4941-bec2-bfcf29c3951a', 'volume_name': 'volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51df04c1-16d0-461d-af51-f70b0fa1fed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51df04c1-16d0-461d-af51-f70b0fa1fed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89499e1-2318-4742-b5c3-b54f406f019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:34 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Volume 543c84fd-a2c3-4941-bec2-bfcf29c3951a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a', 'volume_size': 1}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-958585783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543c84fd-a2c3-4941-bec2-bfcf29c3951a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a94aaf277e0458284c913639d7c8b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:35Z,use_quota=True,user_id='cce6fcb564a74171b12858b1dc2af8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Creating volume 543c84fd-a2c3-4941-bec2-bfcf29c3951a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:34 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:34 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a 1073741824
Apr 08 11:08:34 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:35 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a 1073741824" returned: 0 in 0.600s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:35 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a
Apr 08 11:08:35 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:35 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a" returned: 0 in 0.475s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89499e1-2318-4742-b5c3-b54f406f019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c59a5fe-35f0-4799-99a9-b1bb3031c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Volume volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a (543c84fd-a2c3-4941-bec2-bfcf29c3951a): created successfully
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c59a5fe-35f0-4799-99a9-b1bb3031c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Flow 'volume_create_manager' (7fd478a7-b76c-41d8-ba77-8f75c4f0062a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-503ef65c-0922-4ca1-bed2-a932a4a1b670 tempest-ServersNegativeTestJSON-849288336 None] Created volume successfully.
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=122,cinder:INSERT=43,cinder:UPDATE=167,cinder:DELETE=13 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Flow 'volume_create_manager' (ff8ec7ed-7719-475e-b2ca-6bd4c70b4dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a05a97-2f4d-4404-a0f9-c37f64df3673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a05a97-2f4d-4404-a0f9-c37f64df3673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-948498765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a94aaf277e0458284c913639d7c8b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:38Z,use_quota=True,user_id='cce6fcb564a74171b12858b1dc2af8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e533dc7-9d61-4a5d-8fe6-5a85f2837f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e533dc7-9d61-4a5d-8fe6-5a85f2837f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5de14ef-dea0-4d3e-988b-a120b97c0387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5de14ef-dea0-4d3e-988b-a120b97c0387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36', 'volume_name': 'volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c754f2-1111-400c-9b0e-7a6e0ea0044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c754f2-1111-400c-9b0e-7a6e0ea0044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbb4e43-6e98-481d-a691-db453d7e37dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:37 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Volume cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36', 'volume_size': 1}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-948498765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a94aaf277e0458284c913639d7c8b47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:38Z,use_quota=True,user_id='cce6fcb564a74171b12858b1dc2af8ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Creating volume cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:37 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:37 devstack sudo[89387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 1073741824
Apr 08 11:08:37 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:38 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 1073741824" returned: 0 in 0.598s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:38 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36
Apr 08 11:08:38 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:38 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" returned: 0 in 0.415s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbb4e43-6e98-481d-a691-db453d7e37dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e788cc-144a-4b83-a07c-477748f20815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:38 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Volume volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 (cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36): created successfully
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e788cc-144a-4b83-a07c-477748f20815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:38 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Flow 'volume_create_manager' (ff8ec7ed-7719-475e-b2ca-6bd4c70b4dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-764b8afe-4883-4f76-b221-eabdacff6e9e tempest-ServersNegativeTestJSON-849288336 None] Created volume successfully.
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "cinder-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "cinder-quobyte-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-quobyte-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8ebc31-1cdf-4360-bb2d-62592f8e74b5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:40 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36
Apr 08 11:08:40 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:40 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:40 devstack sudo[89434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36
Apr 08 11:08:40 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:41 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" returned: 0 in 0.410s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-quobyte-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36" released by "delete_volume" :: held 0.883s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Created reservations ['cf80d2a8-f54c-4674-af1f-83d4c149d73e', '148e2fa9-abb5-48c9-be1f-2240d0ad8a3d', '1009a8af-9fdb-49f0-aad8-e190a8041dff', 'dd419c9d-9553-4633-a782-eaf2d51f45b9'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:41 devstack sudo[89437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:41 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "cinder-543c84fd-a2c3-4941-bec2-bfcf29c3951a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-543c84fd-a2c3-4941-bec2-bfcf29c3951a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "cinder-quobyte-543c84fd-a2c3-4941-bec2-bfcf29c3951a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-quobyte-543c84fd-a2c3-4941-bec2-bfcf29c3951a" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed872a2-d5f5-440e-a3ca-73db3b2b01e1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:41 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a
Apr 08 11:08:41 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:41 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.427s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Deleted volume successfully.
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79df34ff-b26d-473c-ad8c-73d0e0b8ade0 tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-cf4a8d0e-a92b-4cf0-b8d8-1589e4c54f36-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:41 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a" returned: 0 in 0.467s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:41 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a
Apr 08 11:08:41 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:42 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-543c84fd-a2c3-4941-bec2-bfcf29c3951a" returned: 0 in 0.396s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-quobyte-543c84fd-a2c3-4941-bec2-bfcf29c3951a" released by "delete_volume" :: held 0.882s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Created reservations ['a328d418-41a6-427b-9597-4b6d59eed8d7', '5c20eae0-9926-438c-8a3c-20d14d298424', 'b6fb200a-7f51-4862-b2e5-697bc5cf73c3', '2835e9b3-3058-4a33-878b-a830ba7ee4f0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:42 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:42 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:42 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Deleted volume successfully.
Apr 08 11:08:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-71e310d6-dad5-4ad6-90d0-d251d96f08bc tempest-ServersNegativeTestJSON-849288336 None] Lock "cinder-543c84fd-a2c3-4941-bec2-bfcf29c3951a-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (8489dfcb-b4c2-43cd-bd1c-bfc49b926457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608931c6-3cb2-49b1-8fbe-93db862383dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608931c6-3cb2-49b1-8fbe-93db862383dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1352269026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b41636-ae8f-40b2-aa31-f07791c1bffa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:52Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c32cbed-d331-4b3e-8aa7-b8f52de9cec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c32cbed-d331-4b3e-8aa7-b8f52de9cec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6856c7ba-6f70-4ab9-80cb-852c85688278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6856c7ba-6f70-4ab9-80cb-852c85688278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b41636-ae8f-40b2-aa31-f07791c1bffa', 'volume_name': 'volume-15b41636-ae8f-40b2-aa31-f07791c1bffa', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b065b-61c1-4c7c-91bf-277ba19cea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9b065b-61c1-4c7c-91bf-277ba19cea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e7be7b-42ec-4d50-a382-235a2ca9416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Volume 15b41636-ae8f-40b2-aa31-f07791c1bffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b41636-ae8f-40b2-aa31-f07791c1bffa', 'volume_size': 1}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1352269026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b41636-ae8f-40b2-aa31-f07791c1bffa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:52Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Creating volume 15b41636-ae8f-40b2-aa31-f07791c1bffa {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:52 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:52 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa 1073741824
Apr 08 11:08:52 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:52 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa 1073741824" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:53 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa
Apr 08 11:08:53 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:53 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa" returned: 0 in 0.401s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e7be7b-42ec-4d50-a382-235a2ca9416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b41636-ae8f-40b2-aa31-f07791c1bffa', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78602ead-6f6f-433a-ab74-0faef14082fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Volume volume-15b41636-ae8f-40b2-aa31-f07791c1bffa (15b41636-ae8f-40b2-aa31-f07791c1bffa): created successfully
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78602ead-6f6f-433a-ab74-0faef14082fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (8489dfcb-b4c2-43cd-bd1c-bfc49b926457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:53 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2467bb96-737d-45db-98fb-f1564fedbd97 tempest-VolumesTestJSON-1146153306 None] Created volume successfully.
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (1b46f475-65f2-44f0-909f-cd99008f96ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15346257-0752-45d7-a0a9-01f57e9d1800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15346257-0752-45d7-a0a9-01f57e9d1800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2000052093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af6f608-50ee-4027-ad1a-0be3dd701966,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:54Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6eede8-39d0-4cac-90d6-308c51fe1f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6eede8-39d0-4cac-90d6-308c51fe1f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7a09d-269e-419c-9928-40e903b6fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d7a09d-269e-419c-9928-40e903b6fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af6f608-50ee-4027-ad1a-0be3dd701966', 'volume_name': 'volume-3af6f608-50ee-4027-ad1a-0be3dd701966', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979ad511-9567-491e-9afd-b435bd4711e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979ad511-9567-491e-9afd-b435bd4711e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86614e7-4422-4862-967c-2b53e21793df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Volume 3af6f608-50ee-4027-ad1a-0be3dd701966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af6f608-50ee-4027-ad1a-0be3dd701966', 'volume_size': 1}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2000052093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af6f608-50ee-4027-ad1a-0be3dd701966,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:54Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Creating volume 3af6f608-50ee-4027-ad1a-0be3dd701966 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:53 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:53 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 1073741824
Apr 08 11:08:53 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:54 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 1073741824" returned: 0 in 0.454s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:54 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966
Apr 08 11:08:54 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:54 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966" returned: 0 in 0.399s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86614e7-4422-4862-967c-2b53e21793df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af6f608-50ee-4027-ad1a-0be3dd701966', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff57e39-769a-48c6-90e8-f19d5a15b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:54 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Volume volume-3af6f608-50ee-4027-ad1a-0be3dd701966 (3af6f608-50ee-4027-ad1a-0be3dd701966): created successfully
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff57e39-769a-48c6-90e8-f19d5a15b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (1b46f475-65f2-44f0-909f-cd99008f96ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5d014724-f2cb-4698-8040-7c62a7e26746 tempest-VolumesTestJSON-1146153306 None] Created volume successfully.
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (13f7cba3-97ed-447f-ae61-0ce005227d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfea19a-bfb9-469c-a406-15e6ea1faeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfea19a-bfb9-469c-a406-15e6ea1faeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813161607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380907c-9d11-4d53-8803-5676e3e3034a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:55Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc7f970-600b-41da-a520-2547407790ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc7f970-600b-41da-a520-2547407790ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1eadd7-fc86-49ed-a201-606a6efa6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1eadd7-fc86-49ed-a201-606a6efa6502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd380907c-9d11-4d53-8803-5676e3e3034a', 'volume_name': 'volume-d380907c-9d11-4d53-8803-5676e3e3034a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff859f97-aa97-4a6f-b836-8f9beb2c353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff859f97-aa97-4a6f-b836-8f9beb2c353d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e23223-cc0b-4dac-a574-84d5f45605f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:55 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Volume d380907c-9d11-4d53-8803-5676e3e3034a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d380907c-9d11-4d53-8803-5676e3e3034a', 'volume_size': 1}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1813161607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380907c-9d11-4d53-8803-5676e3e3034a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c90099f14f704f3db4c270a21a797920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:08:55Z,use_quota=True,user_id='6e6cbf0cb512497890a5ae97e4461383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Creating volume d380907c-9d11-4d53-8803-5676e3e3034a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:08:55 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:55 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a 1073741824
Apr 08 11:08:55 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:55 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a 1073741824" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:55 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a
Apr 08 11:08:55 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:55 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a" returned: 0 in 0.387s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e23223-cc0b-4dac-a574-84d5f45605f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d380907c-9d11-4d53-8803-5676e3e3034a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a61ce1-c1e0-4cca-a9b7-c38cddde69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:08:56 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Volume volume-d380907c-9d11-4d53-8803-5676e3e3034a (d380907c-9d11-4d53-8803-5676e3e3034a): created successfully
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a61ce1-c1e0-4cca-a9b7-c38cddde69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Flow 'volume_create_manager' (13f7cba3-97ed-447f-ae61-0ce005227d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:08:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f3484f47-278f-4de5-b01e-2c246cd61ca0 tempest-VolumesTestJSON-1146153306 None] Created volume successfully.
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-d380907c-9d11-4d53-8803-5676e3e3034a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-d380907c-9d11-4d53-8803-5676e3e3034a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-quobyte-d380907c-9d11-4d53-8803-5676e3e3034a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-d380907c-9d11-4d53-8803-5676e3e3034a" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aefa63a-1e65-4a09-ae8e-4cf4e2d3012e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:56 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a
Apr 08 11:08:56 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:57 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a" returned: 0 in 0.443s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:57 devstack sudo[89517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a
Apr 08 11:08:57 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:57 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d380907c-9d11-4d53-8803-5676e3e3034a" returned: 0 in 0.391s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-d380907c-9d11-4d53-8803-5676e3e3034a" released by "delete_volume" :: held 0.863s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Created reservations ['c2ba40d6-58f7-4dfe-ab32-16da882af2a9', '97ad2820-a0c1-46c2-bfcb-891a4ab51707', '8371abe3-d696-4d8b-bd4c-81aceefd27c9', '826a4f03-d9e1-4463-9933-6efc22d25399'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:57 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:57 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-3af6f608-50ee-4027-ad1a-0be3dd701966-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-3af6f608-50ee-4027-ad1a-0be3dd701966-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-quobyte-3af6f608-50ee-4027-ad1a-0be3dd701966" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-3af6f608-50ee-4027-ad1a-0be3dd701966" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b601ced-dda4-4649-85db-8b845bf9fb79]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:57 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966
Apr 08 11:08:57 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:58 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Deleted volume successfully.
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3d182b95-b694-4b51-aed8-38fce086cf76 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-d380907c-9d11-4d53-8803-5676e3e3034a-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:58 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966" returned: 0 in 0.463s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:58 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966
Apr 08 11:08:58 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:58 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3af6f608-50ee-4027-ad1a-0be3dd701966" returned: 0 in 0.390s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-3af6f608-50ee-4027-ad1a-0be3dd701966" released by "delete_volume" :: held 0.873s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Created reservations ['a2fc5ecc-0731-4bdf-9105-6f1d11633050', '0caff473-ceb1-4bcc-a582-3e1a962fbe87', 'a6da2a5f-798a-4950-afbc-88af78801d32', '36e3d3cf-dd0e-43fc-827c-fa82bbdf5119'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:58 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:58 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-15b41636-ae8f-40b2-aa31-f07791c1bffa-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-15b41636-ae8f-40b2-aa31-f07791c1bffa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "cinder-quobyte-15b41636-ae8f-40b2-aa31-f07791c1bffa" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-15b41636-ae8f-40b2-aa31-f07791c1bffa" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd0b017-3938-44d2-9e0f-1b08a92e628c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:08:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:59 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa
Apr 08 11:08:59 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:59 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.430s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:08:59 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Deleted volume successfully.
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79b9c824-6d79-47a3-aa2f-7d574625d884 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-3af6f608-50ee-4027-ad1a-0be3dd701966-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:59 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:59 devstack sudo[89539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa
Apr 08 11:08:59 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:08:59 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-15b41636-ae8f-40b2-aa31-f07791c1bffa" returned: 0 in 0.384s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-quobyte-15b41636-ae8f-40b2-aa31-f07791c1bffa" released by "delete_volume" :: held 0.857s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Created reservations ['fe57ce5f-1770-43f9-8ba4-2e9dd19d0960', '1ab19fdf-71da-4859-b856-e7131a5fb352', '8ed9aea5-5aba-4fec-b098-61403025bc40', '515073fe-c6f2-4c8b-b161-b1db05cdee2b'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:08:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:08:59 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:08:59 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:00 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.415s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:00 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:00 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Deleted volume successfully.
Apr 08 11:09:00 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-68c17c92-238b-4c6b-afc3-f69e20a4adf7 tempest-VolumesTestJSON-1146153306 None] Lock "cinder-15b41636-ae8f-40b2-aa31-f07791c1bffa-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:02 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0c7433f4-7761-4764-b1af-6643cd1d8dc1 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-87944793: creating
Apr 08 11:09:02 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0c7433f4-7761-4764-b1af-6643cd1d8dc1 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-87944793: created successfully
Apr 08 11:09:02 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0c7433f4-7761-4764-b1af-6643cd1d8dc1 tempest-GroupSnapshotsTest-33792190 None] Create group completed successfully.
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:02 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:09:02 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:02 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.388s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:02 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (d7f3dd74-d478-48fb-b3aa-78216af3d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ab6d31-e1f3-4393-873e-22f30f635f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ab6d31-e1f3-4393-873e-22f30f635f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200745057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2e76ce8-d810-4a6c-a4f1-92261f112921,host='devstack@QuobyteHD#QuobyteHD',id=2ca9bf73-871d-4175-895d-9e6725a6e936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:03Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ecdb6e0-f0c1-47df-9c9c-e7ba93b936cb),volume_type_id=0ecdb6e0-f0c1-47df-9c9c-e7ba93b936cb)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a468e3-3cb9-4d32-972d-0cdc4265f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a468e3-3cb9-4d32-972d-0cdc4265f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6f1e4e-faee-421a-854d-d4ac3881636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6f1e4e-faee-421a-854d-d4ac3881636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca9bf73-871d-4175-895d-9e6725a6e936', 'volume_name': 'volume-2ca9bf73-871d-4175-895d-9e6725a6e936', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a95ea1-89ed-4bfd-8a80-0ed924d04ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a95ea1-89ed-4bfd-8a80-0ed924d04ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d99826e-c7d3-4214-8d26-0819dbe975a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:03 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Volume 2ca9bf73-871d-4175-895d-9e6725a6e936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca9bf73-871d-4175-895d-9e6725a6e936', 'volume_size': 1}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2e76ce8-d810-4a6c-a4f1-92261f112921,created_at=2026-04-08T09:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200745057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2e76ce8-d810-4a6c-a4f1-92261f112921,host='devstack@QuobyteHD#QuobyteHD',id=2ca9bf73-871d-4175-895d-9e6725a6e936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:03Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ecdb6e0-f0c1-47df-9c9c-e7ba93b936cb),volume_type_id=0ecdb6e0-f0c1-47df-9c9c-e7ba93b936cb)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Creating volume 2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:09:03 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:03 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 1073741824
Apr 08 11:09:03 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:03 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 1073741824" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:03 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:03 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:04 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.398s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d99826e-c7d3-4214-8d26-0819dbe975a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca9bf73-871d-4175-895d-9e6725a6e936', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e0ad9b-34e5-45ae-8838-9f96b52517a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:04 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Volume volume-2ca9bf73-871d-4175-895d-9e6725a6e936 (2ca9bf73-871d-4175-895d-9e6725a6e936): created successfully
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e0ad9b-34e5-45ae-8838-9f96b52517a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (d7f3dd74-d478-48fb-b3aa-78216af3d133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-091b1cd3-53b2-4bfe-9634-0f31fd7dc335 tempest-GroupSnapshotsTest-33792190 None] Created volume successfully.
Apr 08 11:09:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] GroupSnapshot f747e909-16da-42db-805f-7f547b80adfc: creating.
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Group snapshot f747e909-16da-42db-805f-7f547b80adfc: creating. {{(pid=82670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Creating offline snapshot 1022dcc8-06d7-4059-8733-214e326d9779 of volume 2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ba31a-e114-455c-a044-f48709089316]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:04 devstack sudo[89558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:04 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:05 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:05 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 1G
Apr 08 11:09:05 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:05 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 1G" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca9bf73-871d-4175-895d-9e6725a6e936 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:05 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca9bf73-871d-4175-895d-9e6725a6e936 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:05 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:05 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca9bf73-871d-4175-895d-9e6725a6e936 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:05 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:05 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:05 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:06 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.387s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:06 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info
Apr 08 11:09:06 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:06 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info" returned: 0 in 0.397s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:06 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:06 devstack sudo[89579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info
Apr 08 11:09:06 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:07 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.info" returned: 0 in 0.391s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b9e88091-161a-4a6b-856e-9f0485116b92 tempest-GroupSnapshotsTest-33792190 None] group_snapshot f747e909-16da-42db-805f-7f547b80adfc: created successfully
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779-6b9ca904-52e0-443e-80da-65fe5497e77b" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779-6b9ca904-52e0-443e-80da-65fe5497e77b" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Creating volume 6b9ca904-52e0-443e-80da-65fe5497e77b from snapshot 1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] snapshot: 1022dcc8-06d7-4059-8733-214e326d9779, volume: 6b9ca904-52e0-443e-80da-65fe5497e77b,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd821e0f-3968-4b24-a0c1-a454950b2462]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:08 devstack sudo[89582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:08 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:09 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.458s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca9bf73-871d-4175-895d-9e6725a6e936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876b1c7-4428-4a80-aab0-1b2961ecff50]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:09 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:09 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:09 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.462s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:09:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:09 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b
Apr 08 11:09:09 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:11 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b" returned: 0 in 1.791s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c92c465-657e-4f7e-b149-99b6f1a1ed7d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:11 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:11 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:11 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.561s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:09:11 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Converted 1024.00 MB image at 571.39 MB/s
Apr 08 11:09:11 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:11 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b
Apr 08 11:09:11 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:12 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" released by "_copy_volume_from_snapshot" :: held 3.739s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779-6b9ca904-52e0-443e-80da-65fe5497e77b" released by "_create_volume_from_snapshot" :: held 3.755s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.764s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e614ac21-cd20-4679-a21b-c96d5ae2abbe tempest-GroupSnapshotsTest-33792190 None] Create group from source-snapshot-f747e909-16da-42db-805f-7f547b80adfc completed successfully.
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc2578-7c1a-453c-8324-ebdf73287f46]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:13 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b
Apr 08 11:09:13 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:13 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b" returned: 0 in 0.448s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:13 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b
Apr 08 11:09:13 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:14 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6b9ca904-52e0-443e-80da-65fe5497e77b" returned: 0 in 0.390s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-6b9ca904-52e0-443e-80da-65fe5497e77b" released by "delete_volume" :: held 0.859s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Created reservations ['9c42f954-9dac-490f-8855-51a0f54f4406'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:14 devstack cinder-volume[82670]: WARNING cinder.quota [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1644220671 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1644220671, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:14 devstack cinder-volume[82670]: WARNING cinder.quota [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1644220671 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1644220671, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Created reservations ['1c300466-8776-4ada-8f84-8c56c4b0c1f5', '33383943-3359-408a-851b-60721baa25b4', '5105a1e7-a8b8-4816-a114-580f9c29ade6', '1f8a024b-9003-48d4-9d9e-00ddf8692972'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:14 devstack sudo[89623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:09:14 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] group_snapshot f747e909-16da-42db-805f-7f547b80adfc: deleting
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] group_snapshot f747e909-16da-42db-805f-7f547b80adfc: deleting {{(pid=82670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Deleting offline snapshot 1022dcc8-06d7-4059-8733-214e326d9779 of volume 2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] snapshot_file for this snap is: volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96bc4d-91d6-4e61-bca7-fa8a3b85bac8]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:14 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:14 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:14 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-53e0c921-03f4-4ccb-88a5-e63517beb6bb tempest-GroupSnapshotsTest-33792190 None] Delete group completed successfully.
Apr 08 11:09:14 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca9bf73-871d-4175-895d-9e6725a6e936(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6612e34-d61f-426f-ba26-33885394a3b4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:14 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:14 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:15 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:15 devstack sudo[89636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:15 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:15 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.438s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:15 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779
Apr 08 11:09:15 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:16 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936.1022dcc8-06d7-4059-8733-214e326d9779" returned: 0 in 0.394s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-1022dcc8-06d7-4059-8733-214e326d9779" released by "_delete_snapshot" :: held 1.807s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" released by "delete_snapshot" :: held 1.816s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:16 devstack cinder-volume[82670]: WARNING cinder.quota [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1644220671 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1644220671, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['0a2b4018-a791-4a32-9ef7-0749083d182f', '1e8b148c-e0cb-4263-a843-9320b7447c11', 'a32b729d-bc19-4f86-9508-7f7fb03e7b2c', 'e2210fc0-e64b-4585-915c-774638f0374d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3e729f37-008e-45ac-b1d4-24b0ae419405 tempest-GroupSnapshotsTest-33792190 None] group_snapshot f747e909-16da-42db-805f-7f547b80adfc: deleted successfully
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7067f5f-7578-4b31-b1b3-3e0ea7638bf0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:16 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:16 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:17 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:17 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936
Apr 08 11:09:17 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:17 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-2ca9bf73-871d-4175-895d-9e6725a6e936" returned: 0 in 0.389s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-2ca9bf73-871d-4175-895d-9e6725a6e936" released by "delete_volume" :: held 0.875s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Created reservations ['bd0812a2-e56f-48c5-929d-e38fad48b97f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:17 devstack cinder-volume[82670]: WARNING cinder.db.sqlalchemy.api [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1644220671']
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Created reservations ['39e4b038-bf2c-489f-93c9-6aab0d511fd1', 'f30cd183-d0ec-4014-8f1e-54c0ce74687d', 'a3a0c25d-92cd-4492-ba1c-0c22030ed848', 'd2f95295-6fa3-4acc-b662-c375f9f20010'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:17 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:09:17 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1e9a0a11-1fff-4647-a31c-678acb7eaf12 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-1220013347: creating
Apr 08 11:09:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1e9a0a11-1fff-4647-a31c-678acb7eaf12 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-1220013347: created successfully
Apr 08 11:09:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1e9a0a11-1fff-4647-a31c-678acb7eaf12 tempest-GroupSnapshotsTest-33792190 None] Create group completed successfully.
Apr 08 11:09:18 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.437s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:18 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-55d5f860-6b6b-4daa-822c-c0edfa3f45fc tempest-GroupSnapshotsTest-33792190 None] Delete group completed successfully.
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (0f5d9bdf-1756-4ed6-9214-14a369ddbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256c780f-fb95-4c60-9e76-f7f5de8f6fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256c780f-fb95-4c60-9e76-f7f5de8f6fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472745254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,host='devstack@QuobyteHD#QuobyteHD',id=3ba9e7f8-044a-48ec-ad70-4db4a50837f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:19Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9277a6af-a2f5-4ec0-b7ba-141a4670cb1f),volume_type_id=9277a6af-a2f5-4ec0-b7ba-141a4670cb1f)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f2355e-766d-46d2-8af1-d8bcc6067897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f2355e-766d-46d2-8af1-d8bcc6067897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d5348e-61ac-4344-a16e-e458d2cc0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d5348e-61ac-4344-a16e-e458d2cc0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba9e7f8-044a-48ec-ad70-4db4a50837f8', 'volume_name': 'volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437169e-d04d-4216-af6c-173455991ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c437169e-d04d-4216-af6c-173455991ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7032db7c-265f-42dd-a3cf-ca542cb9bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:19 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Volume 3ba9e7f8-044a-48ec-ad70-4db4a50837f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8', 'volume_size': 1}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,created_at=2026-04-08T09:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472745254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,host='devstack@QuobyteHD#QuobyteHD',id=3ba9e7f8-044a-48ec-ad70-4db4a50837f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:19Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9277a6af-a2f5-4ec0-b7ba-141a4670cb1f),volume_type_id=9277a6af-a2f5-4ec0-b7ba-141a4670cb1f)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Creating volume 3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:09:19 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:19 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 1073741824
Apr 08 11:09:19 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:19 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 1073741824" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:19 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8
Apr 08 11:09:19 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:20 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" returned: 0 in 0.390s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7032db7c-265f-42dd-a3cf-ca542cb9bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c8ed5d-2e38-4b87-8c41-a86b5d3cfe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Volume volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 (3ba9e7f8-044a-48ec-ad70-4db4a50837f8): created successfully
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c8ed5d-2e38-4b87-8c41-a86b5d3cfe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (0f5d9bdf-1756-4ed6-9214-14a369ddbf81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b415dd7a-126e-4590-bdf7-71aded5e0b78 tempest-GroupSnapshotsTest-33792190 None] Created volume successfully.
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (5d34dfcc-3ca9-4caa-ba9d-4d2266d07ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a060c620-8545-4198-b5f4-edbe41880e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a060c620-8545-4198-b5f4-edbe41880e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2115221887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,host='devstack@QuobyteHD#QuobyteHD',id=fa5a2bd7-4888-4b91-93f6-46d5b1b62de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:21Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9277a6af-a2f5-4ec0-b7ba-141a4670cb1f),volume_type_id=9277a6af-a2f5-4ec0-b7ba-141a4670cb1f)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c8a1b3-a75a-4b98-857b-e2060aa65146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c8a1b3-a75a-4b98-857b-e2060aa65146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb0269f-57c6-4855-b984-15bccb046510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb0269f-57c6-4855-b984-15bccb046510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5a2bd7-4888-4b91-93f6-46d5b1b62de3', 'volume_name': 'volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ebcfdd-5867-4ed4-ae7f-997f9a0717dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ebcfdd-5867-4ed4-ae7f-997f9a0717dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764e8deb-87c3-43b4-8b7c-eaa6a1844f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Volume fa5a2bd7-4888-4b91-93f6-46d5b1b62de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3', 'volume_size': 1}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,created_at=2026-04-08T09:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2115221887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5dd7a7a2-a1a7-4f14-9bbd-0ad113feacf9,host='devstack@QuobyteHD#QuobyteHD',id=fa5a2bd7-4888-4b91-93f6-46d5b1b62de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:21Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9277a6af-a2f5-4ec0-b7ba-141a4670cb1f),volume_type_id=9277a6af-a2f5-4ec0-b7ba-141a4670cb1f)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Creating volume fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:09:20 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:09:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:20 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 1073741824
Apr 08 11:09:20 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:21 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 1073741824" returned: 0 in 0.461s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:21 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3
Apr 08 11:09:21 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:21 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" returned: 0 in 0.398s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764e8deb-87c3-43b4-8b7c-eaa6a1844f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2da2f3-6018-43e0-aaaa-bfb0e373afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Volume volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 (fa5a2bd7-4888-4b91-93f6-46d5b1b62de3): created successfully
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2da2f3-6018-43e0-aaaa-bfb0e373afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (5d34dfcc-3ca9-4caa-ba9d-4d2266d07ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b8dfbc08-9340-4016-b0fb-571145c3db14 tempest-GroupSnapshotsTest-33792190 None] Created volume successfully.
Apr 08 11:09:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-8cdfdf21-893d-4421-9bb1-0fad2877c92d tempest-GroupSnapshotsTest-33792190 None] Update group completed successfully.
Apr 08 11:09:23 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a541a54c-7a63-4683-bf50-a599b40f6c0e tempest-GroupSnapshotsTest-33792190 None] Update group completed successfully.
Apr 08 11:09:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-9ee42866-d768-467d-83be-c323897d5217 tempest-GroupSnapshotsTest-33792190 None] Update group completed successfully.
Apr 08 11:09:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-40f12a2b-687c-44be-af00-0e2eb28e2c98 tempest-GroupSnapshotsTest-33792190 None] Update group completed successfully.
Apr 08 11:09:26 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] GroupSnapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: creating.
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Group snapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: creating. {{(pid=82670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Creating offline snapshot 516dbf88-f6db-42a7-b3f2-bc9e4ef755cf of volume fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[857881b9-b3e1-40c4-8cdc-61ad23319b0b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:26 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3
Apr 08 11:09:26 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:27 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:27 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf 1G
Apr 08 11:09:27 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:27 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf 1G" returned: 0 in 0.448s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:27 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf
Apr 08 11:09:27 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:28 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" returned: 0 in 0.426s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:28 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:28 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf
Apr 08 11:09:28 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:28 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" returned: 0 in 0.397s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:28 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info
Apr 08 11:09:28 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:28 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info" returned: 0 in 0.406s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:28 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:28 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info
Apr 08 11:09:28 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:29 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.info" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Creating offline snapshot d2f823c1-ad1b-464f-8c15-99b3d4f5c60e of volume 3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aa424e-3b51-4adf-bd77-c0194a32305a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:29 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8
Apr 08 11:09:29 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:29 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:29 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e 1G
Apr 08 11:09:29 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:30 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e 1G" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:30 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e
Apr 08 11:09:30 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:30 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:30 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:30 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e
Apr 08 11:09:30 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:31 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" returned: 0 in 0.403s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:31 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info
Apr 08 11:09:31 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:31 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info" returned: 0 in 0.393s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:31 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:31 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info
Apr 08 11:09:31 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:31 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.info" returned: 0 in 0.393s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-85be4704-7251-4090-83d7-298ea3dd5a8c tempest-GroupSnapshotsTest-33792190 None] group_snapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: created successfully
Apr 08 11:09:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] group_snapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: deleting
Apr 08 11:09:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] group_snapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: deleting {{(pid=82670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Deleting offline snapshot 516dbf88-f6db-42a7-b3f2-bc9e4ef755cf of volume fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] snapshot_file for this snap is: volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[056c4bf9-28ac-4b0b-915d-d5a84e0485d5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:33 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf
Apr 08 11:09:33 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:33 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f5546-feeb-411b-87a9-f6e3045c70e7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:33 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3
Apr 08 11:09:33 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:34 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:34 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf
Apr 08 11:09:34 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:34 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:34 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf
Apr 08 11:09:34 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:34 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3.516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-516dbf88-f6db-42a7-b3f2-bc9e4ef755cf" released by "_delete_snapshot" :: held 1.827s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" released by "delete_snapshot" :: held 1.838s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Deleting offline snapshot d2f823c1-ad1b-464f-8c15-99b3d4f5c60e of volume 3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] snapshot_file for this snap is: volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4fe2fc-4b43-4b5f-9912-8cc6314ae431]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:34 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e
Apr 08 11:09:34 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:35 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" returned: 0 in 0.489s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7a8fd-6260-45a0-9a38-283db7f71f2f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:35 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8
Apr 08 11:09:35 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:35 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:35 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e
Apr 08 11:09:35 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:36 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" returned: 0 in 0.438s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:36 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e
Apr 08 11:09:36 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:36 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8.d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" returned: 0 in 0.401s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-d2f823c1-ad1b-464f-8c15-99b3d4f5c60e" released by "_delete_snapshot" :: held 1.842s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" released by "delete_snapshot" :: held 1.850s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=94,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=9 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:09:36 devstack cinder-volume[82670]: WARNING cinder.quota [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-165865781 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-165865781, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:36 devstack cinder-volume[82670]: WARNING cinder.quota [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-165865781 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-165865781, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Created reservations ['3957876a-9afb-49b3-89e1-dd0bb68ffcef', '4fb330b8-11fc-4b1c-8a66-5777cf51245e', 'd5878130-8923-4951-aac3-63a6ebb130b1', '993c1edb-0cd8-4841-9abb-bce05f27d7e6'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:36 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] Created reservations ['092c0515-5c2b-4d63-9ad5-c13a70535a19', '40be053b-3eeb-48b6-b190-53dcce830521', 'c4f8ee5e-7886-4f07-8723-46cf90c59e70', 'f056a6c8-fc35-46c7-bddd-286ac41667a8'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b64d2adc-1779-4efc-99fc-19ceb8a62bda tempest-GroupSnapshotsTest-33792190 None] group_snapshot 4468aab4-0574-4c5e-a4c7-0f5314eb4bef: deleted successfully
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b018d4-63e2-42d1-b43b-b0398f645053]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:37 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8
Apr 08 11:09:37 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:37 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:37 devstack sudo[89769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8
Apr 08 11:09:37 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:38 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" returned: 0 in 0.390s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-3ba9e7f8-044a-48ec-ad70-4db4a50837f8" released by "delete_volume" :: held 0.869s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c532e24-8f4d-4580-bed2-c65c9b73bce9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:38 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3
Apr 08 11:09:38 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:38 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" returned: 0 in 0.460s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:38 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3
Apr 08 11:09:38 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:39 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" returned: 0 in 0.400s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-fa5a2bd7-4888-4b91-93f6-46d5b1b62de3" released by "delete_volume" :: held 0.885s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=114,cinder:UPDATE=111,cinder:INSERT=23,cinder:DELETE=4 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['c257228c-f71a-4b7c-9895-a2f85986e990'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:39 devstack cinder-volume[82670]: WARNING cinder.quota [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-165865781 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-165865781, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['312c48e2-e728-4f96-bd7a-3789f6c25a6d', 'e84fff15-ea23-4a2f-8bc1-72478221c1fc', 'ff8ec5ec-e16f-4e0b-8301-180a60b5d51b', '54a9a7bf-8905-4311-b0e2-e6afb932ad02'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['81ff915f-b767-4dea-b506-cdc3c303dfea', 'bef2ad3b-627f-4413-94c1-d2ff8b8f040c', '7f212cab-5e6e-4266-bb7e-01b912f82c3b', '332176bb-9213-412c-b451-bebab2be2ac9'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:39 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:09:39 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:39 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.417s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:39 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-777ebd91-6c5b-47ff-8066-0488725be0e1 tempest-GroupSnapshotsTest-33792190 None] Delete group completed successfully.
Apr 08 11:09:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dedfcce1-4176-4efa-bbe9-e7ee3ec2b672 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-565510149: creating
Apr 08 11:09:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dedfcce1-4176-4efa-bbe9-e7ee3ec2b672 tempest-GroupSnapshotsTest-33792190 None] Group tempest-GroupSnapshotsTest-Group-565510149: created successfully
Apr 08 11:09:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dedfcce1-4176-4efa-bbe9-e7ee3ec2b672 tempest-GroupSnapshotsTest-33792190 None] Create group completed successfully.
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (5fd5c18d-763e-4b8c-94de-e5cd654f099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac37ef7-2232-4bdf-b090-b5e625ccf532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac37ef7-2232-4bdf-b090-b5e625ccf532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905089993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a576e58-1b58-40b0-95b8-6e40b190061e,host='devstack@QuobyteHD#QuobyteHD',id=49aee33e-b55c-4ace-8d6d-8306e31a388a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:41Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be713655-cf47-4c40-a3e8-f07f4733ef0a),volume_type_id=be713655-cf47-4c40-a3e8-f07f4733ef0a)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab2ff51-f4b2-4aa0-9f50-88279e338cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab2ff51-f4b2-4aa0-9f50-88279e338cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cbcc49-6c97-4962-a374-9c9e062520d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cbcc49-6c97-4962-a374-9c9e062520d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49aee33e-b55c-4ace-8d6d-8306e31a388a', 'volume_name': 'volume-49aee33e-b55c-4ace-8d6d-8306e31a388a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab72f9c-a976-498c-8810-5419edda9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab72f9c-a976-498c-8810-5419edda9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eedc96b-9c56-4b71-bd6b-0d8539823377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:41 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Volume 49aee33e-b55c-4ace-8d6d-8306e31a388a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49aee33e-b55c-4ace-8d6d-8306e31a388a', 'volume_size': 1}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7a576e58-1b58-40b0-95b8-6e40b190061e,created_at=2026-04-08T09:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905089993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7a576e58-1b58-40b0-95b8-6e40b190061e,host='devstack@QuobyteHD#QuobyteHD',id=49aee33e-b55c-4ace-8d6d-8306e31a388a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb042bb41bd147edb820d120ef64ac23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:09:41Z,use_quota=True,user_id='85cbcdddddba4ca3a7bb41ecfa0c5fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be713655-cf47-4c40-a3e8-f07f4733ef0a),volume_type_id=be713655-cf47-4c40-a3e8-f07f4733ef0a)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Creating volume 49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:09:41 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:41 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a 1073741824
Apr 08 11:09:41 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:41 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a 1073741824" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:41 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a
Apr 08 11:09:41 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:42 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a" returned: 0 in 0.397s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eedc96b-9c56-4b71-bd6b-0d8539823377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49aee33e-b55c-4ace-8d6d-8306e31a388a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073f5519-d12c-4e81-a447-49fae6a79b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:09:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Volume volume-49aee33e-b55c-4ace-8d6d-8306e31a388a (49aee33e-b55c-4ace-8d6d-8306e31a388a): created successfully
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073f5519-d12c-4e81-a447-49fae6a79b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Flow 'volume_create_manager' (5fd5c18d-763e-4b8c-94de-e5cd654f099f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:09:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-da08e299-30a0-4dbd-83ce-0f339d4a119d tempest-GroupSnapshotsTest-33792190 None] Created volume successfully.
Apr 08 11:09:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] GroupSnapshot 1681d62c-e810-4531-868e-35aae7c11f4b: creating.
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Group snapshot 1681d62c-e810-4531-868e-35aae7c11f4b: creating. {{(pid=82670) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Creating offline snapshot 105b596f-9719-482c-b33b-00fef941afcb of volume 49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0839e6a-00a5-45c7-a025-a33624c4d1bd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:42 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a
Apr 08 11:09:42 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:42 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:42 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb 1G
Apr 08 11:09:42 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:43 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb 1G" returned: 0 in 0.468s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49aee33e-b55c-4ace-8d6d-8306e31a388a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:43 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49aee33e-b55c-4ace-8d6d-8306e31a388a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb
Apr 08 11:09:43 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:43 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49aee33e-b55c-4ace-8d6d-8306e31a388a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:43 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:43 devstack sudo[89841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb
Apr 08 11:09:43 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:44 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb" returned: 0 in 0.389s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:44 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info
Apr 08 11:09:44 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:44 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info" returned: 0 in 0.396s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:44 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:44 devstack sudo[89847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info
Apr 08 11:09:44 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:44 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.info" returned: 0 in 0.387s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:44 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-32dad697-bc05-4c43-bceb-92137aeb0ab1 tempest-GroupSnapshotsTest-33792190 None] group_snapshot 1681d62c-e810-4531-868e-35aae7c11f4b: created successfully
Apr 08 11:09:45 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] group_snapshot 1681d62c-e810-4531-868e-35aae7c11f4b: deleting
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] group_snapshot 1681d62c-e810-4531-868e-35aae7c11f4b: deleting {{(pid=82670) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-105b596f-9719-482c-b33b-00fef941afcb" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-105b596f-9719-482c-b33b-00fef941afcb" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Deleting offline snapshot 105b596f-9719-482c-b33b-00fef941afcb of volume 49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] snapshot_file for this snap is: volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23e7043-257a-41b1-9ea8-471ea3afb92c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:45 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb
Apr 08 11:09:45 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:46 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb" returned: 0 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49aee33e-b55c-4ace-8d6d-8306e31a388a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681c59b-a560-4bda-bf95-2123ab9e4cdf]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:46 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a
Apr 08 11:09:46 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:46 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a" returned: 0 in 0.465s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:46 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb
Apr 08 11:09:46 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:47 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb" returned: 0 in 0.440s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:47 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb
Apr 08 11:09:47 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:47 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a.105b596f-9719-482c-b33b-00fef941afcb" returned: 0 in 0.397s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-105b596f-9719-482c-b33b-00fef941afcb" released by "_delete_snapshot" :: held 1.812s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" released by "delete_snapshot" :: held 1.822s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:47 devstack cinder-volume[82670]: WARNING cinder.quota [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-608608642 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-608608642, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:47 devstack cinder-volume[82670]: WARNING cinder.quota [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-608608642 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-608608642, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['f790f588-b7d6-4c89-a4f4-8cc669c88bca', 'd3eaa08d-9ef0-4554-809b-68c4822d69a1', 'c36116e6-3455-4752-86a9-7f213efea2d4', '13d2a26c-26ce-4ff3-bca7-a91ef2ace12f'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d5fc9543-ddff-42ac-b5db-b7e1fe358774 tempest-GroupSnapshotsTest-33792190 None] group_snapshot 1681d62c-e810-4531-868e-35aae7c11f4b: deleted successfully
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a2cdad-6cf7-4556-9b3f-403c92ca3397]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:09:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:48 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a
Apr 08 11:09:48 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:48 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a" returned: 0 in 0.456s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:48 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a
Apr 08 11:09:48 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:48 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-49aee33e-b55c-4ace-8d6d-8306e31a388a" returned: 0 in 0.401s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Lock "cinder-quobyte-49aee33e-b55c-4ace-8d6d-8306e31a388a" released by "delete_volume" :: held 0.885s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['884c282d-bdc9-4898-b8f7-6e881746bfe0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:48 devstack cinder-volume[82670]: WARNING cinder.quota [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-608608642 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-608608642, it is now deprecated. Please use the default quota class for default quota.
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Created reservations ['6dcf0779-6323-4485-b737-c83856ae13e0', 'ce5031ca-31c0-4101-a60e-94cdaf943fc7', '63799621-d32c-4bf1-b33e-bd19c914b28a', '8e4c4de6-daf3-4762-8dad-32d9f90be3ca'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:09:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:09:48 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:09:48 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:09:49 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 08 11:09:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:09:49 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:09:49 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4122bd24-298b-4020-9683-bd0b4007d748 tempest-GroupSnapshotsTest-33792190 None] Delete group completed successfully.
Apr 08 11:09:58 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=48,cinder:INSERT=20,cinder:UPDATE=58 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:09:58 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=37,cinder:UPDATE=37,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:02 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:02 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:03 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (28382113-f2b1-462f-9023-f51b6655e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6e8103-a43c-45ab-aecf-038c275ff434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6e8103-a43c-45ab-aecf-038c275ff434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-973375004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31c80ae-e9f9-4776-9f2c-77065ea576ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:04Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e54d51-429f-4d22-98f1-b117b1a4ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e54d51-429f-4d22-98f1-b117b1a4ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccf6971-b627-422f-bbeb-b4545dedd7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccf6971-b627-422f-bbeb-b4545dedd7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31c80ae-e9f9-4776-9f2c-77065ea576ea', 'volume_name': 'volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0bd2a9-af83-42c8-8eb3-4c425eef53fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0bd2a9-af83-42c8-8eb3-4c425eef53fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548459fe-9128-485c-9390-4e566e192c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:03 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Volume b31c80ae-e9f9-4776-9f2c-77065ea576ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea', 'volume_size': 1}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-973375004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31c80ae-e9f9-4776-9f2c-77065ea576ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:04Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Creating volume b31c80ae-e9f9-4776-9f2c-77065ea576ea {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:03 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:03 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea 1073741824
Apr 08 11:10:03 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:04 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea 1073741824" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:04 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea
Apr 08 11:10:04 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:04 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea" returned: 0 in 0.386s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548459fe-9128-485c-9390-4e566e192c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358c309f-d51b-4562-9ff3-9c6b7ca321cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:04 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Volume volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea (b31c80ae-e9f9-4776-9f2c-77065ea576ea): created successfully
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358c309f-d51b-4562-9ff3-9c6b7ca321cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (28382113-f2b1-462f-9023-f51b6655e75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d41e448f-d3ba-4adb-843a-8ef0b17756fb tempest-VolumesListAdminTestJSON-1473170663 None] Created volume successfully.
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (81858095-a6ce-4b65-9ae1-073e2f49fd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2c4660-a114-4e52-9099-60a79dd9bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2c4660-a114-4e52-9099-60a79dd9bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1088111617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0b6713-a3bb-4e39-9f42-5d344744bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:05Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e25d17-7da5-4f72-9cc3-28aca87da0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e25d17-7da5-4f72-9cc3-28aca87da0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f347ce-9821-49a5-9aad-d71899f7a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f347ce-9821-49a5-9aad-d71899f7a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0b6713-a3bb-4e39-9f42-5d344744bb45', 'volume_name': 'volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be68c3ce-e595-4c59-9c15-a86544acfa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be68c3ce-e595-4c59-9c15-a86544acfa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9c651b-83ea-4882-9627-89eeb2be9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:05 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Volume ee0b6713-a3bb-4e39-9f42-5d344744bb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45', 'volume_size': 1}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1088111617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0b6713-a3bb-4e39-9f42-5d344744bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:05Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Creating volume ee0b6713-a3bb-4e39-9f42-5d344744bb45 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:05 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:05 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 1073741824
Apr 08 11:10:05 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:05 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 1073741824" returned: 0 in 0.462s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:05 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45
Apr 08 11:10:05 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:05 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45" returned: 0 in 0.395s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9c651b-83ea-4882-9627-89eeb2be9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28ff81-0849-4f63-b0d9-ef66a3ceb07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Volume volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 (ee0b6713-a3bb-4e39-9f42-5d344744bb45): created successfully
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28ff81-0849-4f63-b0d9-ef66a3ceb07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (81858095-a6ce-4b65-9ae1-073e2f49fd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1c194afb-ad2a-4c10-87db-7687256ba036 tempest-VolumesListAdminTestJSON-1473170663 None] Created volume successfully.
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (8673cc3f-869c-4ee5-98d3-2defde4607ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943bdb65-0d97-43e8-a465-53de125f87b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943bdb65-0d97-43e8-a465-53de125f87b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-245295305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5859bcc-79e7-4fc8-be0a-57623e991384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:06Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158e183-8c8b-4d91-a408-d8af8d7ca2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158e183-8c8b-4d91-a408-d8af8d7ca2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8244b936-593f-4077-8bf6-60097fb8bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8244b936-593f-4077-8bf6-60097fb8bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5859bcc-79e7-4fc8-be0a-57623e991384', 'volume_name': 'volume-e5859bcc-79e7-4fc8-be0a-57623e991384', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a374827-7672-4e08-a50b-337cfb35aec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a374827-7672-4e08-a50b-337cfb35aec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64963aca-9bba-4519-a5ce-07171dc0ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:06 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Volume e5859bcc-79e7-4fc8-be0a-57623e991384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5859bcc-79e7-4fc8-be0a-57623e991384', 'volume_size': 1}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-245295305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5859bcc-79e7-4fc8-be0a-57623e991384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9846fafd43964387b2f913fa47d1f79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:06Z,use_quota=True,user_id='5b7225156f494048862f0e7730b4668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Creating volume e5859bcc-79e7-4fc8-be0a-57623e991384 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:06 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:06 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 1073741824
Apr 08 11:10:06 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:06 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 1073741824" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:06 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384
Apr 08 11:10:06 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:07 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384" returned: 0 in 0.406s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64963aca-9bba-4519-a5ce-07171dc0ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5859bcc-79e7-4fc8-be0a-57623e991384', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b6aa1f-62c8-4fd1-b751-6e9526a2878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Volume volume-e5859bcc-79e7-4fc8-be0a-57623e991384 (e5859bcc-79e7-4fc8-be0a-57623e991384): created successfully
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b6aa1f-62c8-4fd1-b751-6e9526a2878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Flow 'volume_create_manager' (8673cc3f-869c-4ee5-98d3-2defde4607ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-02978b07-4ecb-4b52-b996-8af62f445663 tempest-VolumesListAdminTestJSON-1473170663 None] Created volume successfully.
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Flow 'volume_create_manager' (5f8dac88-63ce-4348-aa95-e293c5520df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0c9e8-b891-433a-8747-562bbe253d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d0c9e8-b891-433a-8747-562bbe253d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ad5a85-0682-4f3c-8dc5-aa112b8470ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d552c29da044c598a7c791b8da22ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:08Z,use_quota=True,user_id='29e1b220e33b449d9af6d5f406db0854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65536d-3aa2-4c0f-a2ca-5b5cac3ba737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d65536d-3aa2-4c0f-a2ca-5b5cac3ba737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233140b6-4dfc-4215-8132-e2c78931c920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233140b6-4dfc-4215-8132-e2c78931c920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ad5a85-0682-4f3c-8dc5-aa112b8470ee', 'volume_name': 'volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e951618f-98e0-474d-9f97-e2069af398aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e951618f-98e0-474d-9f97-e2069af398aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa8d8fa-1c3a-4a78-8994-cb3f98e54505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:07 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Volume e3ad5a85-0682-4f3c-8dc5-aa112b8470ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee', 'volume_size': 1}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ad5a85-0682-4f3c-8dc5-aa112b8470ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d552c29da044c598a7c791b8da22ba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:08Z,use_quota=True,user_id='29e1b220e33b449d9af6d5f406db0854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Creating volume e3ad5a85-0682-4f3c-8dc5-aa112b8470ee {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:07 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:07 devstack sudo[89909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee 1073741824
Apr 08 11:10:07 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:08 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee 1073741824" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:08 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee
Apr 08 11:10:08 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:08 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" returned: 0 in 0.400s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa8d8fa-1c3a-4a78-8994-cb3f98e54505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b1ac5f-5a51-408d-bbdb-3209a28c7389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:08 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Volume volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee (e3ad5a85-0682-4f3c-8dc5-aa112b8470ee): created successfully
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b1ac5f-5a51-408d-bbdb-3209a28c7389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Flow 'volume_create_manager' (5f8dac88-63ce-4348-aa95-e293c5520df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-889bd3ae-8051-46d0-91bc-252e814230b9 tempest-VolumesListAdminTestJSON-593347423 None] Created volume successfully.
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Acquiring lock "cinder-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "cinder-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Acquiring lock "cinder-quobyte-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "cinder-quobyte-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79779d-c436-44df-845d-c3c098d7ee3c]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-e5859bcc-79e7-4fc8-be0a-57623e991384-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-e5859bcc-79e7-4fc8-be0a-57623e991384-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:08 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee
Apr 08 11:10:08 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-quobyte-e5859bcc-79e7-4fc8-be0a-57623e991384" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-e5859bcc-79e7-4fc8-be0a-57623e991384" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d61b058-d671-4c20-abc9-404ed686b077]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:09 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384
Apr 08 11:10:09 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:09 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" returned: 0 in 0.478s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:09 devstack sudo[89927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee
Apr 08 11:10:09 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:09 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:09 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384
Apr 08 11:10:09 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:09 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" returned: 0 in 0.403s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "cinder-quobyte-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee" released by "delete_volume" :: held 0.917s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Created reservations ['f1130d20-6a63-4b3a-992e-71acaa37b0c2', '93e8c8c5-e545-4a47-9fa1-e3ffc6ea4ac5', 'd8c07e3f-c8d0-4f9d-85ee-9a580b8b49dd', 'd82e7113-38bb-45f0-bd46-773b9954fefb'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:10:09 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e5859bcc-79e7-4fc8-be0a-57623e991384" returned: 0 in 0.416s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-e5859bcc-79e7-4fc8-be0a-57623e991384" released by "delete_volume" :: held 0.898s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:09 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:09 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Created reservations ['5ace1a24-aa03-4134-9612-1879fba92add', '6de3a453-a2f7-4b53-86a9-707ae200c040', '9e342aa2-d981-4757-af5a-ac31de9c8bbf', '5238a7af-73a6-419e-90b6-f0f7fe416a1d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:09 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:09 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-ee0b6713-a3bb-4e39-9f42-5d344744bb45-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-ee0b6713-a3bb-4e39-9f42-5d344744bb45-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-quobyte-ee0b6713-a3bb-4e39-9f42-5d344744bb45" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-ee0b6713-a3bb-4e39-9f42-5d344744bb45" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6648ea2e-d6ad-4760-bb17-639d16708901]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:10 devstack sudo[89937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45
Apr 08 11:10:10 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:10 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.435s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Deleted volume successfully.
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f559130e-6330-4e1b-9911-81efb8b4e132 tempest-VolumesListAdminTestJSON-593347423 None] Lock "cinder-e3ad5a85-0682-4f3c-8dc5-aa112b8470ee-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:10 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.446s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:10 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Deleted volume successfully.
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4f60f11-1d1e-4930-be42-555a2fe8872f tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-e5859bcc-79e7-4fc8-be0a-57623e991384-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:10 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:10 devstack sudo[89944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45
Apr 08 11:10:10 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:11 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-ee0b6713-a3bb-4e39-9f42-5d344744bb45" returned: 0 in 0.389s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-ee0b6713-a3bb-4e39-9f42-5d344744bb45" released by "delete_volume" :: held 0.894s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Created reservations ['8d50b44f-daac-41b9-aa73-41546efb67df', 'b5641301-4ea5-4228-a436-aa632c52e1b4', '5bf9b9dd-4ac6-43ce-9be0-733ef8698abf', 'a6fb47e8-af28-47a4-932e-65d1bfdcdfcd'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:11 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:11 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-b31c80ae-e9f9-4776-9f2c-77065ea576ea-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-b31c80ae-e9f9-4776-9f2c-77065ea576ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "cinder-quobyte-b31c80ae-e9f9-4776-9f2c-77065ea576ea" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-b31c80ae-e9f9-4776-9f2c-77065ea576ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c643f1-5015-4a6d-9248-69ffadc30382]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:11 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea
Apr 08 11:10:11 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:11 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.409s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:11 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Deleted volume successfully.
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-b37241de-4262-463d-925b-a11daafbd8d7 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-ee0b6713-a3bb-4e39-9f42-5d344744bb45-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:11 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:11 devstack sudo[89956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea
Apr 08 11:10:11 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:12 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b31c80ae-e9f9-4776-9f2c-77065ea576ea" returned: 0 in 0.400s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-quobyte-b31c80ae-e9f9-4776-9f2c-77065ea576ea" released by "delete_volume" :: held 0.874s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Created reservations ['3ffb82c1-7565-41e0-ba9c-d3a556202486', 'd747cd38-1c98-4d45-ad44-634246b62be8', '9a91ecf2-a1b7-4dab-b2ee-7a5b6ae82bf3', 'ba5a9b6b-80e8-470e-967d-9f4e98ea5117'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:12 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:12 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:12 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Deleted volume successfully.
Apr 08 11:10:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-50f01227-b39d-4cd9-8768-6105892f8269 tempest-VolumesListAdminTestJSON-1473170663 None] Lock "cinder-b31c80ae-e9f9-4776-9f2c-77065ea576ea-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Flow 'volume_create_manager' (0f67b2eb-2f74-4628-8c0d-9c59bd8c0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1744ed3b-ec95-4090-a1b1-83b8c6364521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1744ed3b-ec95-4090-a1b1-83b8c6364521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-281146966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411cdafa-0170-4a68-aba0-a416214d4205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d91fefb008441d88f697e2275cf5ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:16Z,use_quota=True,user_id='c9a083fa58b24b5b8a9a7bd8164c726e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007dc2a9-b432-4633-bdd2-628026cfd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007dc2a9-b432-4633-bdd2-628026cfd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76df3bc-b16a-4fb0-a632-a8f3e5a9ebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.image.glance [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Creating Keystone auth plugin from conf {{(pid=82670) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c76df3bc-b16a-4fb0-a632-a8f3e5a9ebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '411cdafa-0170-4a68-aba0-a416214d4205', 'volume_name': 'volume-411cdafa-0170-4a68-aba0-a416214d4205', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2cac4c0>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de165281-e548-4743-ad69-0b0dc2ec6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de165281-e548-4743-ad69-0b0dc2ec6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c06e64-96ed-40f2-87d3-121e5f990f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:16 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Volume 411cdafa-0170-4a68-aba0-a416214d4205: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-411cdafa-0170-4a68-aba0-a416214d4205', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2cac4c0>}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Trying to clone 411cdafa-0170-4a68-aba0-a416214d4205 from image e79cd67c-0f76-457d-af5e-4472f723e6f9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]). {{(pid=82670) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 08 11:10:16 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Image download 20.69 MB at 20.69 MB/s
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11d0508-7f1f-4076-816c-4035f3e711d9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:16 devstack sudo[89965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD
Apr 08 11:10:16 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:17 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 is fetched for user c9a083fa58b24b5b8a9a7bd8164c726e. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3902b87-6c09-4655-aec3-b89f8d6d6e72]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:17 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD
Apr 08 11:10:17 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:17 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-281146966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411cdafa-0170-4a68-aba0-a416214d4205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d91fefb008441d88f697e2275cf5ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:16Z,use_quota=True,user_id='c9a083fa58b24b5b8a9a7bd8164c726e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Creating volume 411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:17 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:17 devstack sudo[89975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1073741824
Apr 08 11:10:17 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:18 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1073741824" returned: 0 in 0.460s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:18 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:18 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:18 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 0 in 0.402s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Attempting download of e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume 411cdafa-0170-4a68-aba0-a416214d4205. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebebba4f-687f-4692-aaa2-c2b3b0efcfe6]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:18 devstack sudo[89983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d
Apr 08 11:10:18 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:18 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d" returned: 0 in 0.437s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:18 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d
Apr 08 11:10:18 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:19 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d" returned: 1 in 0.445s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79cd67c-0f76-457d-af5e-4472f723e6f9_94e89g4d' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c740c7b-e6cc-4c5b-ac91-da5fc4cf703b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:19 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD
Apr 08 11:10:19 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:19 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] e79cd67c-0f76-457d-af5e-4472f723e6f9 was qcow2, converting to raw {{(pid=82670) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 08 11:10:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:19 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:19 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:20 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 0 in 0.807s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:20 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79cd67c-0f76-457d-af5e-4472f723e6f9_r4ty67h9devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:10:20 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Converted 112.00 MB image at 112.00 MB/s
Apr 08 11:10:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:20 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1G
Apr 08 11:10:20 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:21 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 1G" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36f2a6-6fc0-4f9a-bc20-46f814b60747]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:21 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:21 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:21 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:21 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:21 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:21 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 1 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Downloaded image e79cd67c-0f76-457d-af5e-4472f723e6f9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}])) to volume 411cdafa-0170-4a68-aba0-a416214d4205 successfully. {{(pid=82670) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Temporary image e79cd67c-0f76-457d-af5e-4472f723e6f9 for user c9a083fa58b24b5b8a9a7bd8164c726e is deleted. {{(pid=82670) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 08 11:10:21 devstack cinder-volume[82670]: DEBUG cinder.volume.volume_utils [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Marking volume 411cdafa-0170-4a68-aba0-a416214d4205 as bootable. {{(pid=82670) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Copying metadata from image e79cd67c-0f76-457d-af5e-4472f723e6f9 to 411cdafa-0170-4a68-aba0-a416214d4205. {{(pid=82670) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Creating volume glance metadata for volume 411cdafa-0170-4a68-aba0-a416214d4205 backed by image e79cd67c-0f76-457d-af5e-4472f723e6f9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82670) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c06e64-96ed-40f2-87d3-121e5f990f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411cdafa-0170-4a68-aba0-a416214d4205', 'volume_size': 1, 'image_id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79cd67c-0f76-457d-af5e-4472f723e6f9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc91b3efbe7d4e3580715108ac582bce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e79cd67c-0f76-457d-af5e-4472f723e6f9', 'created_at': datetime.datetime(2026, 4, 8, 8, 57, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 8, 8, 57, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79cd67c-0f76-457d-af5e-4472f723e6f9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4ea2cac4c0>}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75611522-1c36-4b8d-8840-645391bffcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:22 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Volume volume-411cdafa-0170-4a68-aba0-a416214d4205 (411cdafa-0170-4a68-aba0-a416214d4205): created successfully
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75611522-1c36-4b8d-8840-645391bffcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Flow 'volume_create_manager' (0f67b2eb-2f74-4628-8c0d-9c59bd8c0fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:22 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e7aff264-f49e-41f7-93f0-e75695d9b719 tempest-VolumesImageMetadata-1217816223 None] Created volume successfully.
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Acquiring lock "cinder-411cdafa-0170-4a68-aba0-a416214d4205-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "cinder-411cdafa-0170-4a68-aba0-a416214d4205-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Acquiring lock "cinder-quobyte-411cdafa-0170-4a68-aba0-a416214d4205" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "cinder-quobyte-411cdafa-0170-4a68-aba0-a416214d4205" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0d859-e350-4747-a9ae-060fd8d83a4e]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:10:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:22 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:22 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:23 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:23 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:23 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:23 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 1 in 0.460s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:10:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:23 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205
Apr 08 11:10:23 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:24 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-411cdafa-0170-4a68-aba0-a416214d4205" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "cinder-quobyte-411cdafa-0170-4a68-aba0-a416214d4205" released by "delete_volume" :: held 1.356s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Created reservations ['dbe5edbb-2755-40d1-a02f-94cbc51189b4', 'fa01f949-5cd5-4493-8917-224adcb37fdd', '32d48fe3-3947-491b-a1c6-5f3e56d31111', 'bb9473cd-9cdc-4c89-9cf3-1a92f6d0498e'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:24 devstack sudo[90039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:10:24 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:24 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.390s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:10:24 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Deleted volume successfully.
Apr 08 11:10:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-79353b3a-269a-440f-89c6-6998cb9b1743 tempest-VolumesImageMetadata-1217816223 None] Lock "cinder-411cdafa-0170-4a68-aba0-a416214d4205-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Flow 'volume_create_manager' (4f29f2f8-c88a-4f21-b4b2-91f05b9ce0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f4908-9b90-457b-899e-9b804e52206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f4908-9b90-457b-899e-9b804e52206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434541973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306d91cf-6d8d-4ed0-97fa-1445ca6a042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e3dda02a5d4a479421a16d9f9ffa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:32Z,use_quota=True,user_id='8ab52a47c4e54a9b964e6ecb43927707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9d42ce-1b68-4027-b42a-5fbb344e011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9d42ce-1b68-4027-b42a-5fbb344e011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba96093-928b-4519-b531-be4bdad0e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba96093-928b-4519-b531-be4bdad0e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306d91cf-6d8d-4ed0-97fa-1445ca6a042f', 'volume_name': 'volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40d56cd-d6a3-4966-a5e0-aa32431e06c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40d56cd-d6a3-4966-a5e0-aa32431e06c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0754b330-a0cc-4e84-a180-05d19a79bb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:31 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f', 'volume_size': 1}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-434541973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306d91cf-6d8d-4ed0-97fa-1445ca6a042f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e3dda02a5d4a479421a16d9f9ffa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:10:32Z,use_quota=True,user_id='8ab52a47c4e54a9b964e6ecb43927707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Creating volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:10:31 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:10:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:31 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f 1073741824
Apr 08 11:10:31 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:32 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f 1073741824" returned: 0 in 0.509s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:10:32 devstack sudo[90054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:10:32 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:10:32 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.396s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0754b330-a0cc-4e84-a180-05d19a79bb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f34fe37-d5d9-42b7-990f-d3aa3487cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:10:32 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Volume volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f (306d91cf-6d8d-4ed0-97fa-1445ca6a042f): created successfully
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f34fe37-d5d9-42b7-990f-d3aa3487cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:10:32 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Flow 'volume_create_manager' (4f29f2f8-c88a-4f21-b4b2-91f05b9ce0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:10:32 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-03e8dcaf-c88d-4f89-8bcb-9f217c809acd tempest-VolumesActionsTest-817963885 None] Created volume successfully.
Apr 08 11:10:42 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:UPDATE=54,cinder:SELECT=46,cinder:INSERT=24,cinder:DELETE=4 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:10:42 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=43,cinder:UPDATE=65,cinder:INSERT=15,cinder:DELETE=7 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3f516405-1f7e-4d69-ad2f-1d4f705d587d tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" by "attach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3f516405-1f7e-4d69-ad2f-1d4f705d587d tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" acquired by "attach_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3f516405-1f7e-4d69-ad2f-1d4f705d587d tempest-VolumesActionsTest-817963885 None] Attaching volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f to instance 21cfd05a-fa9b-4928-8f22-a9f71507d0f5 at mountpoint /dev/vdb on host None.
Apr 08 11:10:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3f516405-1f7e-4d69-ad2f-1d4f705d587d tempest-VolumesActionsTest-817963885 None] Attach volume completed successfully.
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3f516405-1f7e-4d69-ad2f-1d4f705d587d tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" released by "attach_volume" :: held 0.059s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-139ff41e-2127-4b62-8e20-b815ef0c18f9 tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" by "detach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-139ff41e-2127-4b62-8e20-b815ef0c18f9 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:10:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-139ff41e-2127-4b62-8e20-b815ef0c18f9 tempest-VolumesActionsTest-817963885 None] Detaching volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f from instance 21cfd05a-fa9b-4928-8f22-a9f71507d0f5.
Apr 08 11:10:47 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-139ff41e-2127-4b62-8e20-b815ef0c18f9 tempest-VolumesActionsTest-817963885 None] Detach volume completed successfully.
Apr 08 11:10:47 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-139ff41e-2127-4b62-8e20-b815ef0c18f9 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:10:57 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:10:57 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:02 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:11:02 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:02 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.395s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:02 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:11:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5d3883bd-45b6-424f-85e1-0003f62e3d67 tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" by "attach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5d3883bd-45b6-424f-85e1-0003f62e3d67 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" acquired by "attach_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5d3883bd-45b6-424f-85e1-0003f62e3d67 tempest-VolumesActionsTest-817963885 None] Attaching volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f to instance 45e09432-5145-4160-9938-40aa0c5ac007 at mountpoint /dev/vdb on host None.
Apr 08 11:11:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5d3883bd-45b6-424f-85e1-0003f62e3d67 tempest-VolumesActionsTest-817963885 None] Attach volume completed successfully.
Apr 08 11:11:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5d3883bd-45b6-424f-85e1-0003f62e3d67 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" released by "attach_volume" :: held 0.062s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4870e859-4a77-4406-a38b-d0664a03aee5 tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" by "detach_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4870e859-4a77-4406-a38b-d0664a03aee5 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4870e859-4a77-4406-a38b-d0664a03aee5 tempest-VolumesActionsTest-817963885 None] Detaching volume 306d91cf-6d8d-4ed0-97fa-1445ca6a042f from instance 45e09432-5145-4160-9938-40aa0c5ac007.
Apr 08 11:11:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4870e859-4a77-4406-a38b-d0664a03aee5 tempest-VolumesActionsTest-817963885 None] Detach volume completed successfully.
Apr 08 11:11:09 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-4870e859-4a77-4406-a38b-d0664a03aee5 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:17 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393bdc0-6cf1-426c-80d6-eec6da95dba7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:17 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:17 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:18 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:18 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dae483-2b2e-4cee-9e72-88ee6e86fe5a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:18 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:18 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:18 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.16022581-4532-41c1-bc78-18a65bdec7733q71bdt2.img {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:18 devstack sudo[90274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.16022581-4532-41c1-bc78-18a65bdec7733q71bdt2.img
Apr 08 11:11:18 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:19 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=3 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:11:20 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.16022581-4532-41c1-bc78-18a65bdec7733q71bdt2.img" returned: 0 in 1.780s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[076bdfe4-2430-47cb-b4c2-d1181d631546]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:20 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:20 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:20 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.570s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f, size 1024.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.16022581-4532-41c1-bc78-18a65bdec7733q71bdt2.img {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:11:20 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Converted 1024.00 MB image at 575.10 MB/s
Apr 08 11:11:20 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] 16022581-4532-41c1-bc78-18a65bdec773 was raw, no need to convert to raw {{(pid=82670) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 08 11:11:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.505s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Uploaded volume to glance image-id: 16022581-4532-41c1-bc78-18a65bdec773. {{(pid=82670) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 08 11:11:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-97f2fc0b-4ead-440c-9cea-38ed007f19e6 tempest-VolumesActionsTest-817963885 None] Copy volume to image completed successfully.
Apr 08 11:11:30 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[16069da9-5662-44be-9780-172381e48d18]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:31 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:31 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:31 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b920aaf-786a-4e1f-a5ca-cb27f78eb1b0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:31 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:31 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:32 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:32 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img
Apr 08 11:11:32 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:33 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img" returned: 0 in 1.726s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a98956-fb9e-4a3b-bbb3-7ccdf5994afd]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:34 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:34 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:34 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.590s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:34 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f, size 1024.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:11:34 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Converted 1024.00 MB image at 593.07 MB/s
Apr 08 11:11:34 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] ae4b3b21-87cd-4e66-9908-421e6218ef98 was raw, converting to qcow2 {{(pid=82670) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 08 11:11:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fab1d9-078a-4f9f-b634-756158ae116a]: (4, 'raw') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:34 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img
Apr 08 11:11:34 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:35 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img" returned: 0 in 0.449s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:35 devstack sudo[90331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img
Apr 08 11:11:35 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:35 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img" returned: 1 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img' failed. Not Retrying. {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:35 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x
Apr 08 11:11:35 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:35 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Image conversion details: src /opt/stack/data/cinder/conversion/306d91cf-6d8d-4ed0-97fa-1445ca6a042f.temp_image.ae4b3b21-87cd-4e66-9908-421e6218ef98y3zmp4x0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:11:35 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605bb3f-dba8-4aa8-8ecb-e12d68f2f551]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:36 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x
Apr 08 11:11:36 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:36 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ngdcxt0x" returned: 0 in 0.437s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 5.796s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Uploaded volume to glance image-id: ae4b3b21-87cd-4e66-9908-421e6218ef98. {{(pid=82670) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 08 11:11:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a63d1e9d-f4f1-467f-8392-1c3be3aed508 tempest-VolumesActionsTest-817963885 None] Copy volume to image completed successfully.
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Acquiring lock "cinder-quobyte-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "cinder-quobyte-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7d729-d6f7-460f-914c-ffd6317efb16]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:38 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:38 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:38 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:38 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f
Apr 08 11:11:38 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:38 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" returned: 0 in 0.392s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "cinder-quobyte-306d91cf-6d8d-4ed0-97fa-1445ca6a042f" released by "delete_volume" :: held 0.901s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Created reservations ['20286d1c-dd26-4a96-bf5d-6ca3b3589048', 'ba4af5af-66a0-447b-bb66-e6afbbcf7038', '4f6bff8c-1fc0-4eda-a0c6-78b1f3e595dc', 'ba0ec0b4-bcc5-458a-802f-34594050ec1c'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:38 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:11:38 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:39 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:39 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:11:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Deleted volume successfully.
Apr 08 11:11:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-d73f74d9-eef3-4ddd-9b5b-f2ac7ab18098 tempest-VolumesActionsTest-817963885 None] Lock "cinder-306d91cf-6d8d-4ed0-97fa-1445ca6a042f-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Flow 'volume_create_manager' (525f7b7e-1bd5-44d6-8254-0a4812427855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84fe52-cc08-4367-85d7-7170097feeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c84fe52-cc08-4367-85d7-7170097feeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-81464758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa9988e68b340b39b08af54d243b302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:42Z,use_quota=True,user_id='16e55fab504f466fa96ac0c255be014a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee9b97d-e06d-4fa3-a9cc-3791a4ff311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee9b97d-e06d-4fa3-a9cc-3791a4ff311a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a3bcb1-a81d-4418-8529-f6e7aa55038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a3bcb1-a81d-4418-8529-f6e7aa55038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'volume_name': 'volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f29e8-8738-4757-b8a2-bc16fa357a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939f29e8-8738-4757-b8a2-bc16fa357a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034f06c0-be92-4d16-a1fb-a296c7c023a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Volume a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'volume_size': 1}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-81464758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa9988e68b340b39b08af54d243b302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:42Z,use_quota=True,user_id='16e55fab504f466fa96ac0c255be014a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Creating volume a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:11:42 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:11:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:42 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c 1073741824
Apr 08 11:11:42 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:43 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c 1073741824" returned: 0 in 0.467s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:43 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:43 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:43 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.397s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034f06c0-be92-4d16-a1fb-a296c7c023a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c168aa-8d37-4cd2-8742-69afdb8d8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Volume volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c (a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c): created successfully
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c168aa-8d37-4cd2-8742-69afdb8d8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Flow 'volume_create_manager' (525f7b7e-1bd5-44d6-8254-0a4812427855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-cfb1b920-b514-4a8e-abf0-2b7d36cc2337 tempest-VolumesCloneTest-504173946 None] Created volume successfully.
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Flow 'volume_create_manager' (309f4615-197f-453d-9ebe-88d4ad1a5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310b7afa-dd5c-4af5-86a2-443438a31774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310b7afa-dd5c-4af5-86a2-443438a31774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1317198623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332dcaab-dad8-4adc-9990-636e861add0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa9988e68b340b39b08af54d243b302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:44Z,use_quota=True,user_id='16e55fab504f466fa96ac0c255be014a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f114a5-debd-41e0-bd4d-e91b1fbf9c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f114a5-debd-41e0-bd4d-e91b1fbf9c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94684970-3859-4251-a4dc-bd946ee78f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94684970-3859-4251-a4dc-bd946ee78f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '332dcaab-dad8-4adc-9990-636e861add0a', 'volume_name': 'volume-332dcaab-dad8-4adc-9990-636e861add0a', 'volume_size': 2, 'source_volid': 'a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9eca63-05f8-4b09-98d3-f9eca94349d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9eca63-05f8-4b09-98d3-f9eca94349d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d830a423-9ac7-471d-af6a-140c7bc02c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:43 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Volume 332dcaab-dad8-4adc-9990-636e861add0a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-332dcaab-dad8-4adc-9990-636e861add0a', 'volume_size': 2, 'source_volid': 'a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'source_volstatus': 'available'}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:43 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Cloning volume a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c to volume 332dcaab-dad8-4adc-9990-636e861add0a
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Creating offline snapshot 9a643d23-e33f-4cf1-b9e9-464ddd1a877c of volume a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde5340d-584e-4efd-ad4a-d133004af4c5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:44 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:44 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:44 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.486s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:44 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c 1G
Apr 08 11:11:44 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:44 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c 1G" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:44 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:44 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:45 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.434s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:45 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c is being set with open permissions: ugo+rw
Apr 08 11:11:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:45 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:45 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:45 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.399s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:45 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info
Apr 08 11:11:45 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:46 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info" returned: 0 in 0.416s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:46 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info is being set with open permissions: ugo+rw
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:46 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info
Apr 08 11:11:46 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:46 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.info" returned: 0 in 0.393s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] snapshot: 9a643d23-e33f-4cf1-b9e9-464ddd1a877c, volume: 332dcaab-dad8-4adc-9990-636e861add0a,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6087e84-9341-461d-9327-fd1764851df0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:46 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:46 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:47 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.450s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6869e71-4f36-4242-960d-661ebc9241d1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:47 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:47 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:47 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:11:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:47 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a
Apr 08 11:11:47 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:49 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a" returned: 0 in 1.884s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83250d2-e899-4f16-8d44-7bfc912ca705]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:49 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:49 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:49 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.572s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:11:49 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Converted 1024.00 MB image at 543.03 MB/s
Apr 08 11:11:49 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a is being set with open permissions: ugo+rw
Apr 08 11:11:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:49 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a
Apr 08 11:11:49 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:50 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a" returned: 0 in 0.407s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" released by "_copy_volume_from_snapshot" :: held 3.809s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-quobyte-9a643d23-e33f-4cf1-b9e9-464ddd1a877c" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-9a643d23-e33f-4cf1-b9e9-464ddd1a877c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Deleting offline snapshot 9a643d23-e33f-4cf1-b9e9-464ddd1a877c of volume a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] snapshot_file for this snap is: volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6383d2a8-98ce-43ce-9064-5b44e6bc3b16]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:50 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:50 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:50 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.455s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bea804-2d4d-4064-a62f-0a6b41cd1f0a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:50 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:50 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:51 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.476s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:51 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:51 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:51 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.450s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:51 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c
Apr 08 11:11:51 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:52 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c.9a643d23-e33f-4cf1-b9e9-464ddd1a877c" returned: 0 in 0.416s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-9a643d23-e33f-4cf1-b9e9-464ddd1a877c" released by "_delete_snapshot" :: held 1.843s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.362s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d830a423-9ac7-471d-af6a-140c7bc02c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332dcaab-dad8-4adc-9990-636e861add0a', 'volume_size': 2, 'source_volid': 'a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f44d807-5cee-44ff-b850-ae2493c5c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Volume volume-332dcaab-dad8-4adc-9990-636e861add0a (332dcaab-dad8-4adc-9990-636e861add0a): created successfully
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f44d807-5cee-44ff-b850-ae2493c5c809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Flow 'volume_create_manager' (309f4615-197f-453d-9ebe-88d4ad1a5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7e9a3f7a-a101-4216-bdd2-7b33c6b95f00 tempest-VolumesCloneTest-504173946 None] Created volume successfully.
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-332dcaab-dad8-4adc-9990-636e861add0a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "cinder-332dcaab-dad8-4adc-9990-636e861add0a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e4289-9f2b-416f-b6a5-c363990b4b0a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:53 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a
Apr 08 11:11:53 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:53 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a" returned: 0 in 0.452s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:53 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a
Apr 08 11:11:53 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:54 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-332dcaab-dad8-4adc-9990-636e861add0a" returned: 0 in 0.410s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-332dcaab-dad8-4adc-9990-636e861add0a" released by "delete_volume" :: held 0.884s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Created reservations ['d55c18f1-1eae-4d85-80ec-474c9a6bec7d', 'fe3e9782-3bc6-4ed7-9310-504849b1a747', '2e5dbc0c-d20f-48f9-928f-f2ad0d7d883a', '3ed2410f-d727-4fb8-b7c0-e33d95c32281'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:54 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:11:54 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "cinder-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Acquiring lock "cinder-quobyte-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f46fcc-4ec5-44e6-b07d-c0a4138e7fb5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:54 devstack sudo[90487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:54 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:54 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:11:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Deleted volume successfully.
Apr 08 11:11:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ed55a9d3-c4bc-48e0-b20c-ad44f9370783 tempest-VolumesCloneTest-504173946 None] Lock "cinder-332dcaab-dad8-4adc-9990-636e861add0a-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:55 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.492s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:55 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c
Apr 08 11:11:55 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:55 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" returned: 0 in 0.419s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "cinder-quobyte-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c" released by "delete_volume" :: held 0.938s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Created reservations ['24de886f-62fe-4dd6-9471-5826af55beed', '82d6158f-0405-4fff-b80a-911dfd09c083', 'fd8d6576-12ed-4b68-bc1e-8847340809c3', '8b1dbd21-e3d2-4224-b26b-82be408bb120'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:55 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:11:55 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:56 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:56 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:11:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Deleted volume successfully.
Apr 08 11:11:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-f20c07d2-1405-4580-a21a-ed999186efd7 tempest-VolumesCloneTest-504173946 None] Lock "cinder-a7143cf2-7e6c-4c5d-b3a6-d32b58ff967c-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (a8307a31-55e1-45d5-85ee-f059dd8fd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d261a4-1cbe-475e-95f1-42b9791d4aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d261a4-1cbe-475e-95f1-42b9791d4aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975506014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72b7330-ccb2-4753-b006-ac5895fbaf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:57Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3977de-68c0-4b44-b9f0-bc5e33e3411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3977de-68c0-4b44-b9f0-bc5e33e3411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae4992e-e1b8-47f2-9364-3e7578a7cbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae4992e-e1b8-47f2-9364-3e7578a7cbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72b7330-ccb2-4753-b006-ac5895fbaf0d', 'volume_name': 'volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3712dde-c723-481a-8cd6-2dab2d8c6264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3712dde-c723-481a-8cd6-2dab2d8c6264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cef8c7b-4482-4114-a4e2-9aff7903f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Volume e72b7330-ccb2-4753-b006-ac5895fbaf0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d', 'volume_size': 1}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1975506014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72b7330-ccb2-4753-b006-ac5895fbaf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:57Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Creating volume e72b7330-ccb2-4753-b006-ac5895fbaf0d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:11:57 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:57 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d 1073741824
Apr 08 11:11:57 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (9faae37f-92a5-464e-8ef7-efdf7d5b2831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66639545-4fa7-4320-84ec-555cdc677bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66639545-4fa7-4320-84ec-555cdc677bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261409308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3c9f75-3b98-4bef-8f70-60ac742c8339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:57Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a76a18f-1665-49ae-b09c-2f913c6ad0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a76a18f-1665-49ae-b09c-2f913c6ad0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f8c583-6d65-4772-ab1d-cfb2cf01f3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f8c583-6d65-4772-ab1d-cfb2cf01f3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c3c9f75-3b98-4bef-8f70-60ac742c8339', 'volume_name': 'volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e06d42-7eed-447c-ba61-a61521779231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e06d42-7eed-447c-ba61-a61521779231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2422299-b06a-41c8-9a73-1a1a6cec30ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Volume 1c3c9f75-3b98-4bef-8f70-60ac742c8339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339', 'volume_size': 1}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (9e7ab906-e18f-453b-ad7a-75ffe35002bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1db2b0-6994-428f-a201-8d8457a4e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1db2b0-6994-428f-a201-8d8457a4e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1675068091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358f7c9-abcd-4b07-bd9f-bd4e443e0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e34b231-e539-43c3-92eb-89a1d9d00dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e34b231-e539-43c3-92eb-89a1d9d00dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7076ce17-c2f1-49fd-b4d4-d0c1b8fcf565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7076ce17-c2f1-49fd-b4d4-d0c1b8fcf565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e358f7c9-abcd-4b07-bd9f-bd4e443e0bde', 'volume_name': 'volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c8561-1fec-4919-b2c5-7addb23692b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3c8561-1fec-4919-b2c5-7addb23692b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777acb30-57f4-4934-b804-92951736c447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Volume e358f7c9-abcd-4b07-bd9f-bd4e443e0bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde', 'volume_size': 1}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (b85e7def-d293-4c4e-865c-981d7cc7e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c3ebaf-0534-4f8f-8dcc-dfc540569228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c3ebaf-0534-4f8f-8dcc-dfc540569228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170679193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481aea67-bf29-4b70-8425-23a1f23f7a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6f1d65-d471-47ee-94f8-07a354f1bbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f6f1d65-d471-47ee-94f8-07a354f1bbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45307c61-bf60-4a76-8cce-dec2007e22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45307c61-bf60-4a76-8cce-dec2007e22a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481aea67-bf29-4b70-8425-23a1f23f7a33', 'volume_name': 'volume-481aea67-bf29-4b70-8425-23a1f23f7a33', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24311aff-ab74-4341-94c5-5be5a90324b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24311aff-ab74-4341-94c5-5be5a90324b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522d3ecf-c3f4-4495-89c5-cfe2f24ec28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:57 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Volume 481aea67-bf29-4b70-8425-23a1f23f7a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481aea67-bf29-4b70-8425-23a1f23f7a33', 'volume_size': 1}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:57 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d 1073741824" returned: 0 in 0.601s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:57 devstack sudo[90506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d
Apr 08 11:11:57 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (6c7a9236-5281-48d6-9a23-e9890c6eac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1858f-02c3-4a8e-8900-955ef60d86b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1858f-02c3-4a8e-8900-955ef60d86b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749668719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa7365-10ae-455c-9abf-9efc3f602fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db89aa7-5b5d-4d85-b004-b7b4b01f95eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db89aa7-5b5d-4d85-b004-b7b4b01f95eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd7996-8f48-4ed3-a918-dbd2bd2f4e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05dd7996-8f48-4ed3-a918-dbd2bd2f4e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aa7365-10ae-455c-9abf-9efc3f602fd8', 'volume_name': 'volume-99aa7365-10ae-455c-9abf-9efc3f602fd8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63ad834-668a-45d7-b72b-30af435487cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63ad834-668a-45d7-b72b-30af435487cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d6fd3a-3bfb-4b39-8918-e259be09a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Volume 99aa7365-10ae-455c-9abf-9efc3f602fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aa7365-10ae-455c-9abf-9efc3f602fd8', 'volume_size': 1}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:58 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261409308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c3c9f75-3b98-4bef-8f70-60ac742c8339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:57Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Creating volume 1c3c9f75-3b98-4bef-8f70-60ac742c8339 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:11:58 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cef8c7b-4482-4114-a4e2-9aff7903f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5533d498-6bcf-4ae3-840c-c52426e8a6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:58 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 1073741824
Apr 08 11:11:58 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:58 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Volume volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d (e72b7330-ccb2-4753-b006-ac5895fbaf0d): created successfully
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5533d498-6bcf-4ae3-840c-c52426e8a6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (a8307a31-55e1-45d5-85ee-f059dd8fd863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:58 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-24431ec8-a30c-4dc6-accb-97fd63edd638 tempest-CreateVolumesFromImageTest-2116133178 None] Created volume successfully.
Apr 08 11:11:58 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 1073741824" returned: 0 in 0.454s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:58 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339
Apr 08 11:11:58 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:59 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1675068091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358f7c9-abcd-4b07-bd9f-bd4e443e0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Creating volume e358f7c9-abcd-4b07-bd9f-bd4e443e0bde {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:11:59 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2422299-b06a-41c8-9a73-1a1a6cec30ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:59 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde 1073741824
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bac89d-7bd5-4862-acee-a355777f65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:11:59 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:11:59 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Volume volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 (1c3c9f75-3b98-4bef-8f70-60ac742c8339): created successfully
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bac89d-7bd5-4862-acee-a355777f65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (9faae37f-92a5-464e-8ef7-efdf7d5b2831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:11:59 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-b4a4f7a5-9959-45ed-8336-dffd4de86949 tempest-CreateVolumesFromImageTest-2116133178 None] Created volume successfully.
Apr 08 11:11:59 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde 1073741824" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:11:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:11:59 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde
Apr 08 11:11:59 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:00 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" returned: 0 in 0.403s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-170679193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481aea67-bf29-4b70-8425-23a1f23f7a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Creating volume 481aea67-bf29-4b70-8425-23a1f23f7a33 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:00 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (777acb30-57f4-4934-b804-92951736c447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:00 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 1073741824
Apr 08 11:12:00 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408e30b3-935d-4f12-b13e-ab5227f65349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:00 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Volume volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde (e358f7c9-abcd-4b07-bd9f-bd4e443e0bde): created successfully
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408e30b3-935d-4f12-b13e-ab5227f65349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (9e7ab906-e18f-453b-ad7a-75ffe35002bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:00 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f52bb194-dae7-4a43-b50e-78070ac5a18f tempest-CreateVolumesFromImageTest-2116133178 None] Created volume successfully.
Apr 08 11:12:00 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 1073741824" returned: 0 in 0.476s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:00 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:00 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33
Apr 08 11:12:00 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:01 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33" returned: 0 in 0.394s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.946s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749668719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aa7365-10ae-455c-9abf-9efc3f602fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72684e76d6154ca49a4f2da713ddb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:11:58Z,use_quota=True,user_id='965c75d89b114699b1cfab5ccf738e08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Creating volume 99aa7365-10ae-455c-9abf-9efc3f602fd8 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:01 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522d3ecf-c3f4-4495-89c5-cfe2f24ec28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481aea67-bf29-4b70-8425-23a1f23f7a33', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339ca84c-e806-455b-a7b6-881a02e79ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:01 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 1073741824
Apr 08 11:12:01 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Volume volume-481aea67-bf29-4b70-8425-23a1f23f7a33 (481aea67-bf29-4b70-8425-23a1f23f7a33): created successfully
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339ca84c-e806-455b-a7b6-881a02e79ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (b85e7def-d293-4c4e-865c-981d7cc7e97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:01 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-855bd8da-cc43-4ee5-834b-8bdc733881a1 tempest-CreateVolumesFromImageTest-2116133178 None] Created volume successfully.
Apr 08 11:12:01 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 1073741824" returned: 0 in 0.476s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:01 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8
Apr 08 11:12:01 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:01 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8" returned: 0 in 0.407s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d6fd3a-3bfb-4b39-8918-e259be09a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aa7365-10ae-455c-9abf-9efc3f602fd8', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d21c4-48b5-4b3b-9543-64c6e6b037f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:01 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Volume volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 (99aa7365-10ae-455c-9abf-9efc3f602fd8): created successfully
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59d21c4-48b5-4b3b-9543-64c6e6b037f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:01 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Flow 'volume_create_manager' (6c7a9236-5281-48d6-9a23-e9890c6eac93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:02 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-179cee00-7ee3-4c2c-af86-a1e328949cfc tempest-CreateVolumesFromImageTest-2116133178 None] Created volume successfully.
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-99aa7365-10ae-455c-9abf-9efc3f602fd8-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-99aa7365-10ae-455c-9abf-9efc3f602fd8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-quobyte-99aa7365-10ae-455c-9abf-9efc3f602fd8" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-99aa7365-10ae-455c-9abf-9efc3f602fd8" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f79eb-ef64-4845-9fae-428cf4c49355]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:02 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8
Apr 08 11:12:02 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:02 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:02 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:02 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8" returned: 0 in 0.451s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:02 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8
Apr 08 11:12:02 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:02 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.394s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:02 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:03 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-99aa7365-10ae-455c-9abf-9efc3f602fd8" returned: 0 in 0.413s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-99aa7365-10ae-455c-9abf-9efc3f602fd8" released by "delete_volume" :: held 0.889s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Created reservations ['e2852a76-c00e-45de-9484-d66554f75370', '36798dbe-604b-4e82-aec6-02e2216db860', 'd870e41c-fbad-4718-90e0-65d2f7339a77', '4263fced-0d43-41d5-9244-a88bc1fd64e2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:03 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:03 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-481aea67-bf29-4b70-8425-23a1f23f7a33-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-481aea67-bf29-4b70-8425-23a1f23f7a33-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-quobyte-481aea67-bf29-4b70-8425-23a1f23f7a33" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-481aea67-bf29-4b70-8425-23a1f23f7a33" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cec4cab-6c2b-4cd0-87d0-cdf2e3b50d38]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:03 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33
Apr 08 11:12:03 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:03 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.412s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:03 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Deleted volume successfully.
Apr 08 11:12:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-208116ee-55bb-4a74-a4f0-79e1d134c282 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-99aa7365-10ae-455c-9abf-9efc3f602fd8-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:04 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33" returned: 0 in 0.448s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:04 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33
Apr 08 11:12:04 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:04 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-481aea67-bf29-4b70-8425-23a1f23f7a33" returned: 0 in 0.404s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-481aea67-bf29-4b70-8425-23a1f23f7a33" released by "delete_volume" :: held 0.883s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Created reservations ['8b9c3266-c009-45bb-b8d0-59d68f02f010', 'cb3630f0-abb8-4e72-864e-e1741a506d47', '47dcca93-f6c1-4623-8d2e-f7e388acd0ae', '09fddbbd-24fb-45f8-8c6d-a43b9872ec32'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:04 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:04 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-quobyte-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[800691c9-c29b-42f9-a5cb-628cb67ae717]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:04 devstack sudo[90566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde
Apr 08 11:12:04 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:04 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.402s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Deleted volume successfully.
Apr 08 11:12:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3b7633ae-4061-4c83-80eb-f5e810b90ff4 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-481aea67-bf29-4b70-8425-23a1f23f7a33-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:05 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" returned: 0 in 0.464s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:05 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde
Apr 08 11:12:05 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:05 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" returned: 0 in 0.395s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde" released by "delete_volume" :: held 0.887s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Created reservations ['36b41dea-d7da-405a-92db-c50be84b2ada', '8afc570f-5585-469d-a306-92d07135ca33', '8b1c4b89-58d0-46bb-aa18-5b6e8178bf4f', 'e3ce8929-a84f-4019-ae0d-9d295881f301'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:05 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:05 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-1c3c9f75-3b98-4bef-8f70-60ac742c8339-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-1c3c9f75-3b98-4bef-8f70-60ac742c8339-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-quobyte-1c3c9f75-3b98-4bef-8f70-60ac742c8339" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-1c3c9f75-3b98-4bef-8f70-60ac742c8339" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a4988-2b3f-42b5-aa3d-b84861b896ec]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:05 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339
Apr 08 11:12:05 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:06 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.406s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Deleted volume successfully.
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-2bf4cc59-3387-4686-a5eb-3e37e477f6bb tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-e358f7c9-abcd-4b07-bd9f-bd4e443e0bde-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:06 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339" returned: 0 in 0.463s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:06 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339
Apr 08 11:12:06 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:06 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-1c3c9f75-3b98-4bef-8f70-60ac742c8339" returned: 0 in 0.405s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-1c3c9f75-3b98-4bef-8f70-60ac742c8339" released by "delete_volume" :: held 0.898s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Created reservations ['8892186c-f9a6-4f2e-8617-f6c3e2b70f5e', '2af6c909-d41f-4061-a5bf-75c39e109eaf', '7dd71bd2-56e0-4398-801c-2171e5498ae3', '484a9698-b89c-4f72-95ff-220c16a7c0f7'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:06 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:06 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-e72b7330-ccb2-4753-b006-ac5895fbaf0d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-e72b7330-ccb2-4753-b006-ac5895fbaf0d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "cinder-quobyte-e72b7330-ccb2-4753-b006-ac5895fbaf0d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-e72b7330-ccb2-4753-b006-ac5895fbaf0d" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ed6a70-12fc-454a-b599-3f2a3e7665c1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:07 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d
Apr 08 11:12:07 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:07 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.420s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Deleted volume successfully.
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-91ba7013-9438-47e1-afb0-f6004981c685 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-1c3c9f75-3b98-4bef-8f70-60ac742c8339-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:07 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:07 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d
Apr 08 11:12:07 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:07 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e72b7330-ccb2-4753-b006-ac5895fbaf0d" returned: 0 in 0.391s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-quobyte-e72b7330-ccb2-4753-b006-ac5895fbaf0d" released by "delete_volume" :: held 0.869s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Created reservations ['753bf1ca-48dd-4e36-b151-770128308ec9', '626cc535-e17b-4eec-95d7-b85bb779cca6', '5e8e2f30-262f-442f-95c3-516ce63433f6', '7aef8304-82fb-4715-829f-40d33cde0b96'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:07 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:07 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:08 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:08 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Deleted volume successfully.
Apr 08 11:12:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1b8b7e1e-5681-4567-b442-47c5b780c783 tempest-CreateVolumesFromImageTest-2116133178 None] Lock "cinder-e72b7330-ccb2-4753-b006-ac5895fbaf0d-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (6603cd83-4525-4ed7-81bd-b9d6b530b728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdaa2d-d21e-4d7f-9da8-0fe4450dd2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bdaa2d-d21e-4d7f-9da8-0fe4450dd2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299317897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d1d42f-6423-47a7-9c75-4e4c7c134dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d1d42f-6423-47a7-9c75-4e4c7c134dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870444e3-9c1f-4e51-871e-1d40b5c58f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870444e3-9c1f-4e51-871e-1d40b5c58f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b', 'volume_name': 'volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe232511-3398-4178-8c88-a33c945da7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe232511-3398-4178-8c88-a33c945da7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89213fd7-9a3c-4840-a590-0c6ab1b0aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:14 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Volume 0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b', 'volume_size': 1}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1299317897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Creating volume 0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:14 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:15 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b 1073741824
Apr 08 11:12:15 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (6925790e-9d61-4279-81f1-8f4e07a1aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9907bc-38a2-4815-b527-c9ead9205159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9907bc-38a2-4815-b527-c9ead9205159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1687614680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85da7869-bfdf-4bc0-b3a9-d61cc12ee79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5f5e93-168e-4c9b-bcd2-a5db850ecd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5f5e93-168e-4c9b-bcd2-a5db850ecd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3d7ed0-cb80-4b82-bb5d-2bb43f9fcbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3d7ed0-cb80-4b82-bb5d-2bb43f9fcbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85da7869-bfdf-4bc0-b3a9-d61cc12ee79a', 'volume_name': 'volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aac29e-e649-4c18-8ebe-038b75059ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9aac29e-e649-4c18-8ebe-038b75059ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa4aa5-42ad-4943-95cd-25d8b2684ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Volume 85da7869-bfdf-4bc0-b3a9-d61cc12ee79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (99c2f57d-c753-4fd5-93c3-0ff3e483cc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63d856d-c4df-4eec-9869-b3bd66c43a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c63d856d-c4df-4eec-9869-b3bd66c43a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95784468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b103f8-3ebe-4393-a0fe-66b2bef7400e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2262406b-0d30-49f5-8cf4-8dc250bd228d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2262406b-0d30-49f5-8cf4-8dc250bd228d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5218315f-189c-4fda-a8df-f2ed5dbfd955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5218315f-189c-4fda-a8df-f2ed5dbfd955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b103f8-3ebe-4393-a0fe-66b2bef7400e', 'volume_name': 'volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77188e7-8328-4a58-94af-cdf46d97d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77188e7-8328-4a58-94af-cdf46d97d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c206ec-8d1a-4146-bb02-418219b9d1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Volume 11b103f8-3ebe-4393-a0fe-66b2bef7400e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (99ab7f0c-a6c6-4974-9512-86461ebb0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827d2bc7-0194-4cbd-9914-de7c4ed47c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827d2bc7-0194-4cbd-9914-de7c4ed47c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959167630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967b555a-5549-46b1-96b3-cae8ea45bb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05d226a-d8fb-4511-a784-6d4474e55bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05d226a-d8fb-4511-a784-6d4474e55bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81524b51-282c-451d-b8d3-6bda4010da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81524b51-282c-451d-b8d3-6bda4010da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967b555a-5549-46b1-96b3-cae8ea45bb79', 'volume_name': 'volume-967b555a-5549-46b1-96b3-cae8ea45bb79', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a55a75-8c9e-4c72-9eab-c9876b746a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a55a75-8c9e-4c72-9eab-c9876b746a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02b82a3-5e81-4039-8b7e-e76f574a048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume 967b555a-5549-46b1-96b3-cae8ea45bb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967b555a-5549-46b1-96b3-cae8ea45bb79', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (cbb111df-036c-4e6d-b6e8-3f8ba6c822de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908abd97-7cf7-471c-9026-6c169eb1fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908abd97-7cf7-471c-9026-6c169eb1fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257181563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f79879-68db-49b1-b538-f5b0702bf70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d04f99c-de6a-4e75-a352-76404c9fa3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d04f99c-de6a-4e75-a352-76404c9fa3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea54db26-b0f4-4a9b-9c31-3e1ef4560afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea54db26-b0f4-4a9b-9c31-3e1ef4560afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f79879-68db-49b1-b538-f5b0702bf70d', 'volume_name': 'volume-16f79879-68db-49b1-b538-f5b0702bf70d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea33591-cb7d-49a1-b673-39725e539fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea33591-cb7d-49a1-b673-39725e539fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cc2775-5eb1-467c-b196-a943381f28c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Volume 16f79879-68db-49b1-b538-f5b0702bf70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f79879-68db-49b1-b538-f5b0702bf70d', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (b2263844-2595-4dbe-a1da-4376781cc832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c3ff3-1416-4d74-b2f6-12300e238dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c3ff3-1416-4d74-b2f6-12300e238dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490065230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429fc50a-2932-4191-b5c9-8f947f55482e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:16Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f17f19e-54c9-4ad3-bab4-f4dcfea630c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f17f19e-54c9-4ad3-bab4-f4dcfea630c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f851e6-6151-4250-b370-06419cf48e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f851e6-6151-4250-b370-06419cf48e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429fc50a-2932-4191-b5c9-8f947f55482e', 'volume_name': 'volume-429fc50a-2932-4191-b5c9-8f947f55482e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cdc769-a51e-4b8b-b333-5e9051ce3034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83cdc769-a51e-4b8b-b333-5e9051ce3034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276e7b24-12c6-49d4-b85e-0566bb155aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Volume 429fc50a-2932-4191-b5c9-8f947f55482e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429fc50a-2932-4191-b5c9-8f947f55482e', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:15 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b 1073741824" returned: 0 in 0.837s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:15 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b
Apr 08 11:12:15 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (8a77d203-5d83-49b2-ba09-26ba18a465a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec8052-81ac-4c4a-9382-aa3c2763e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ec8052-81ac-4c4a-9382-aa3c2763e386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754253521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16ee75a-5b8a-4502-86b3-2513fe451448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:16Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b55296-7293-479c-921d-8125bf224bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b55296-7293-479c-921d-8125bf224bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a01705-e513-4ebb-a923-55f175071dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a01705-e513-4ebb-a923-55f175071dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16ee75a-5b8a-4502-86b3-2513fe451448', 'volume_name': 'volume-b16ee75a-5b8a-4502-86b3-2513fe451448', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe8709d-e94f-4399-a611-ddf116cfa95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe8709d-e94f-4399-a611-ddf116cfa95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a054a6-a474-4048-94f4-3b5f767725ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:15 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Volume b16ee75a-5b8a-4502-86b3-2513fe451448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16ee75a-5b8a-4502-86b3-2513fe451448', 'volume_size': 1}
Apr 08 11:12:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:16 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1687614680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85da7869-bfdf-4bc0-b3a9-d61cc12ee79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Creating volume 85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:16 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89213fd7-9a3c-4840-a590-0c6ab1b0aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1ed7a4-b649-4c5f-8f74-6c104c6e9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:16 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a 1073741824
Apr 08 11:12:16 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:16 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Volume volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b (0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b): created successfully
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1ed7a4-b649-4c5f-8f74-6c104c6e9914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (6603cd83-4525-4ed7-81bd-b9d6b530b728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:16 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-158587e3-bd03-4c3c-a844-a84bd093a939 tempest-CreateVolumesFromImageTest-1514075259 None] Created volume successfully.
Apr 08 11:12:16 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a 1073741824" returned: 0 in 0.525s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:16 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:16 devstack sudo[90657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:16 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:17 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.430s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.051s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-95784468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b103f8-3ebe-4393-a0fe-66b2bef7400e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Creating volume 11b103f8-3ebe-4393-a0fe-66b2bef7400e {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:17 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01aa4aa5-42ad-4943-95cd-25d8b2684ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:17 devstack sudo[90660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e 1073741824
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7af73e-1001-4b8f-9422-7a266fa48278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:17 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:17 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Volume volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a (85da7869-bfdf-4bc0-b3a9-d61cc12ee79a): created successfully
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7af73e-1001-4b8f-9422-7a266fa48278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (6925790e-9d61-4279-81f1-8f4e07a1aacf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:17 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ae562cef-a210-4900-a1e5-cd3375b319d4 tempest-VolumeDependencyTests-1765098460 None] Created volume successfully.
Apr 08 11:12:17 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e 1073741824" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:17 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:17 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e
Apr 08 11:12:17 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:18 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.913s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959167630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967b555a-5549-46b1-96b3-cae8ea45bb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume 967b555a-5549-46b1-96b3-cae8ea45bb79 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:18 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c206ec-8d1a-4146-bb02-418219b9d1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd933f2-9213-470f-8a08-5f55288fbfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:18 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Volume volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e (11b103f8-3ebe-4393-a0fe-66b2bef7400e): created successfully
Apr 08 11:12:18 devstack sudo[90668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 1073741824
Apr 08 11:12:18 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd933f2-9213-470f-8a08-5f55288fbfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (99c2f57d-c753-4fd5-93c3-0ff3e483cc75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:18 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-05b51d4d-cae8-4060-8ca8-2a6ef9122765 tempest-CreateVolumesFromImageTest-1514075259 None] Created volume successfully.
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:18 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 1073741824" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:18 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:18 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79
Apr 08 11:12:18 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:19 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79" returned: 0 in 0.395s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.725s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257181563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f79879-68db-49b1-b538-f5b0702bf70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:15Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Creating volume 16f79879-68db-49b1-b538-f5b0702bf70d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:19 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=70,cinder:UPDATE=100,cinder:INSERT=19,cinder:DELETE=7 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:12:19 devstack sudo[90676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d 1073741824
Apr 08 11:12:19 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02b82a3-5e81-4039-8b7e-e76f574a048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967b555a-5549-46b1-96b3-cae8ea45bb79', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd9d4ae-ea4e-467b-876b-0918ecbe5cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:19 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-967b555a-5549-46b1-96b3-cae8ea45bb79 (967b555a-5549-46b1-96b3-cae8ea45bb79): created successfully
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd9d4ae-ea4e-467b-876b-0918ecbe5cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (99ab7f0c-a6c6-4974-9512-86461ebb0493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:19 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2001d465-3f89-4f3e-bb49-7d95b40b5909 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:19 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d 1073741824" returned: 0 in 0.569s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:19 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:19 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d
Apr 08 11:12:19 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:20 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.601s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1490065230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429fc50a-2932-4191-b5c9-8f947f55482e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:16Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Creating volume 429fc50a-2932-4191-b5c9-8f947f55482e {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:20 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87cc2775-5eb1-467c-b196-a943381f28c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f79879-68db-49b1-b538-f5b0702bf70d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e 1073741824
Apr 08 11:12:20 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b56ff2-28c3-4c0b-b6f1-cff1037343d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Volume volume-16f79879-68db-49b1-b538-f5b0702bf70d (16f79879-68db-49b1-b538-f5b0702bf70d): created successfully
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b56ff2-28c3-4c0b-b6f1-cff1037343d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (cbb111df-036c-4e6d-b6e8-3f8ba6c822de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:20 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e3a0b948-e305-4c6c-b183-97044d53f931 tempest-CreateVolumesFromImageTest-1514075259 None] Created volume successfully.
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (8eae9d7e-efd5-404c-8670-b3ad08953450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f9738f-c143-44d6-940f-bd6e535c7000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f9738f-c143-44d6-940f-bd6e535c7000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239408524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16c296f-af4e-4f84-8f89-014e5e832116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16c296f-af4e-4f84-8f89-014e5e832116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f0b849-dc18-40f8-b1ac-4881be057194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f0b849-dc18-40f8-b1ac-4881be057194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a', 'volume_name': 'volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8550e22-6bbb-47ac-b28d-0a90f9ca9fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8550e22-6bbb-47ac-b28d-0a90f9ca9fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dca9b9-da03-46d6-bf09-ad4b2307cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:20 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a', 'volume_size': 1}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:20 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e 1073741824" returned: 0 in 0.545s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:20 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:20 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e
Apr 08 11:12:20 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (35b21563-f66b-4c56-b2b3-a52890be56b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c946f4f-8a5a-48ce-803f-6469e3967837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c946f4f-8a5a-48ce-803f-6469e3967837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1875688539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e4e39b-e4b0-45df-b11c-7757c938e9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df01dd1-362d-4b12-9f50-7db7a36f3c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df01dd1-362d-4b12-9f50-7db7a36f3c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a20dbbb-07d4-4bc3-8ef4-382cec4c2479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a20dbbb-07d4-4bc3-8ef4-382cec4c2479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e4e39b-e4b0-45df-b11c-7757c938e9f0', 'volume_name': 'volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785106e1-9c3e-4142-a948-e3676cb97359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785106e1-9c3e-4142-a948-e3676cb97359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a6326e-c732-4f9c-bd6f-5ef00d56deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume 46e4e39b-e4b0-45df-b11c-7757c938e9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0', 'volume_size': 1}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (bc7e4db5-d245-454d-ac7c-32a10a18eec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f6d57-0114-416e-9d68-be87cd88c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f6d57-0114-416e-9d68-be87cd88c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249438247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029db9ee-fef0-4b0a-8984-664fd770bd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a0ac92-6343-4321-af67-f1aaffc9f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a0ac92-6343-4321-af67-f1aaffc9f790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e47b277-1d5c-4a2b-8757-dc786cad1f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e47b277-1d5c-4a2b-8757-dc786cad1f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029db9ee-fef0-4b0a-8984-664fd770bd8c', 'volume_name': 'volume-029db9ee-fef0-4b0a-8984-664fd770bd8c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e61567-4f49-4137-a77e-39c5a6826115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e61567-4f49-4137-a77e-39c5a6826115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe6c41-911e-45f4-860a-2599c5e300fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume 029db9ee-fef0-4b0a-8984-664fd770bd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029db9ee-fef0-4b0a-8984-664fd770bd8c', 'volume_size': 1}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (35678118-d115-4a85-a9e2-1a30c353f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:21 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ba3a15-72ec-42fc-aeeb-db2b7f24e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754253521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16ee75a-5b8a-4502-86b3-2513fe451448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c4e21cf48d4f6dbff3cff779be394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:16Z,use_quota=True,user_id='1b41181182eb4b4bba1d02cc001177bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Creating volume b16ee75a-5b8a-4502-86b3-2513fe451448 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ba3a15-72ec-42fc-aeeb-db2b7f24e74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348768698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e5456b-5541-4787-94ff-f14199556efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 1073741824
Apr 08 11:12:21 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff1f865-dbba-4d08-83f7-c0a2b8ffaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff1f865-dbba-4d08-83f7-c0a2b8ffaec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11586577-886c-4b59-becd-d48079da70ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11586577-886c-4b59-becd-d48079da70ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e5456b-5541-4787-94ff-f14199556efd', 'volume_name': 'volume-45e5456b-5541-4787-94ff-f14199556efd', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c8cf6c-5ecd-4d9e-a021-2c616997276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c8cf6c-5ecd-4d9e-a021-2c616997276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01af5dd-75b7-4620-9d98-e2cf81ef46c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume 45e5456b-5541-4787-94ff-f14199556efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e5456b-5541-4787-94ff-f14199556efd', 'volume_size': 1}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (276e7b24-12c6-49d4-b85e-0566bb155aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429fc50a-2932-4191-b5c9-8f947f55482e', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45d4b34-c205-4d0b-ae14-46f80350b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Volume volume-429fc50a-2932-4191-b5c9-8f947f55482e (429fc50a-2932-4191-b5c9-8f947f55482e): created successfully
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45d4b34-c205-4d0b-ae14-46f80350b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (b2263844-2595-4dbe-a1da-4376781cc832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0386bb07-6cb1-4e4c-a2e3-0cf5551d91f5 tempest-CreateVolumesFromImageTest-1514075259 None] Created volume successfully.
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (a3254033-0dbe-4492-a438-7b4f87a3e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c4338d-f2ac-48dd-a410-e23c35680f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c4338d-f2ac-48dd-a410-e23c35680f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-365576957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3055fc9-dc3a-4087-814b-8d741e08cb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:22Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836c2e8f-a5bc-42f2-a462-50eac96a635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836c2e8f-a5bc-42f2-a462-50eac96a635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128ae83c-7b23-4d4d-ae14-723c9e14e2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128ae83c-7b23-4d4d-ae14-723c9e14e2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3055fc9-dc3a-4087-814b-8d741e08cb5b', 'volume_name': 'volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4167a79-c37e-4b54-babc-dc7a94442874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4167a79-c37e-4b54-babc-dc7a94442874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a6505-1c01-4e1d-a32d-f996507b6b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:21 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume c3055fc9-dc3a-4087-814b-8d741e08cb5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b', 'volume_size': 1}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:21 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 1073741824" returned: 0 in 0.547s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:21 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:22 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448
Apr 08 11:12:22 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:22 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448" returned: 0 in 0.421s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.927s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a054a6-a474-4048-94f4-3b5f767725ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16ee75a-5b8a-4502-86b3-2513fe451448', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4022266-82ed-44de-81fe-9f819ae5365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Creating offline snapshot db599831-3bfa-40fe-821a-7926e79207d3 of volume 85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:12:22 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Volume volume-b16ee75a-5b8a-4502-86b3-2513fe451448 (b16ee75a-5b8a-4502-86b3-2513fe451448): created successfully
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4022266-82ed-44de-81fe-9f819ae5365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Flow 'volume_create_manager' (8a77d203-5d83-49b2-ba09-26ba18a465a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b8404-8065-4e2d-a1cb-5f843681c506]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:22 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-4f70edbc-8003-4f02-9a9f-d5ae1af171e1 tempest-CreateVolumesFromImageTest-1514075259 None] Created volume successfully.
Apr 08 11:12:22 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:22 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:22 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.538s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:22 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:23 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 1G
Apr 08 11:12:23 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-b16ee75a-5b8a-4502-86b3-2513fe451448-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-b16ee75a-5b8a-4502-86b3-2513fe451448-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-quobyte-b16ee75a-5b8a-4502-86b3-2513fe451448" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-b16ee75a-5b8a-4502-86b3-2513fe451448" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:23 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 1G" returned: 0 in 0.531s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[af796d84-3275-45c8-b22c-5d667dbe7d97]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:23 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:23 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:23 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:23 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448
Apr 08 11:12:23 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:24 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.511s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:24 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 is being set with open permissions: ugo+rw
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:24 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448" returned: 0 in 0.517s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:24 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:24 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:24 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448
Apr 08 11:12:24 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:24 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-b16ee75a-5b8a-4502-86b3-2513fe451448" returned: 0 in 0.410s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-b16ee75a-5b8a-4502-86b3-2513fe451448" released by "delete_volume" :: held 0.960s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Created reservations ['a14e8f4a-704a-4114-9ecf-d9160c62150c', '185be1f1-ff38-4736-bb5c-e4f6587bf635', 'd22050b4-614c-4058-961a-3b59380abaa5', 'c6576d1e-01a7-45ae-9039-d016ca98e756'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:24 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:24 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info
Apr 08 11:12:24 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-429fc50a-2932-4191-b5c9-8f947f55482e-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:24 devstack sudo[90728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-429fc50a-2932-4191-b5c9-8f947f55482e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:24 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-quobyte-429fc50a-2932-4191-b5c9-8f947f55482e" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-429fc50a-2932-4191-b5c9-8f947f55482e" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3be45-900b-4608-bf4a-eb4d63b496dc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:24 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:24 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e
Apr 08 11:12:24 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:25 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.545s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:25 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Deleted volume successfully.
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info" returned: 0 in 0.575s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:25 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info is being set with open permissions: ugo+rw
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1a40b572-ee95-4ea3-8618-f6efad0bec61 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-b16ee75a-5b8a-4502-86b3-2513fe451448-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:25 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info
Apr 08 11:12:25 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:25 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:25 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e
Apr 08 11:12:25 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:25 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.info" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.206s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.838s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-239408524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:25 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:25 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-429fc50a-2932-4191-b5c9-8f947f55482e" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:25 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a 1073741824
Apr 08 11:12:25 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-429fc50a-2932-4191-b5c9-8f947f55482e" released by "delete_volume" :: held 1.018s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:25 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c10028a7-c04a-4f77-8c13-86b4416519c8 tempest-VolumeDependencyTests-1765098460 None] Create snapshot completed successfully
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Created reservations ['a9743599-8c9d-417c-ab4e-addcd9edc794', '078c3638-7795-4a5f-8f26-abf74df4045f', '45177289-c5e9-4887-bdac-6e5889774930', '769b2d50-3abf-474e-a7b9-3c53a061e8eb'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:25 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:25 devstack sudo[90746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:25 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (fa0f3c86-9f53-43cf-ad7b-94f9bad09494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7d9d8f-9c9a-4de9-be7d-6ae2bb6617d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7d9d8f-9c9a-4de9-be7d-6ae2bb6617d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1586729972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14865123-71ab-4762-8e82-47769923e3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db599831-3bfa-40fe-821a-7926e79207d3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:26Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e2b4f4-ebbb-45cf-a00e-6b5673a9f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e2b4f4-ebbb-45cf-a00e-6b5673a9f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ff14b-baa8-4c32-979d-b707f802fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ff14b-baa8-4c32-979d-b707f802fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '14865123-71ab-4762-8e82-47769923e3e0', 'volume_name': 'volume-14865123-71ab-4762-8e82-47769923e3e0', 'volume_size': 1, 'snapshot_id': 'db599831-3bfa-40fe-821a-7926e79207d3'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a1151d-6485-4d3f-aed3-c83445e92621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a1151d-6485-4d3f-aed3-c83445e92621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4dc8fc-d80b-4d73-92c7-729b5f9cc3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Volume 14865123-71ab-4762-8e82-47769923e3e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-14865123-71ab-4762-8e82-47769923e3e0', 'volume_size': 1, 'snapshot_id': 'db599831-3bfa-40fe-821a-7926e79207d3'}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:26 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a 1073741824" returned: 0 in 0.600s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:26 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a
Apr 08 11:12:26 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:26 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:26 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Deleted volume successfully.
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e0ebb44e-da7f-410b-9ff1-e27db04a9a14 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-429fc50a-2932-4191-b5c9-8f947f55482e-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:26 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" returned: 0 in 0.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.648s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1875688539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e4e39b-e4b0-45df-b11c-7757c938e9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume 46e4e39b-e4b0-45df-b11c-7757c938e9f0 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:26 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5dca9b9-da03-46d6-bf09-ad4b2307cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 1073741824
Apr 08 11:12:26 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c152af-e289-4e9f-8b4d-e07df5383451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:26 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a (c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a): created successfully
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c152af-e289-4e9f-8b4d-e07df5383451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (8eae9d7e-efd5-404c-8670-b3ad08953450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:26 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f02735ad-1c7b-40b6-925a-6bb60e7c82d7 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-16f79879-68db-49b1-b538-f5b0702bf70d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-16f79879-68db-49b1-b538-f5b0702bf70d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-quobyte-16f79879-68db-49b1-b538-f5b0702bf70d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-16f79879-68db-49b1-b538-f5b0702bf70d" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db20ee-b1b8-4b00-afd8-86f4a2c1b4a2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:26 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:27 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d
Apr 08 11:12:27 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:27 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 1073741824" returned: 0 in 0.655s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:27 devstack sudo[90764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0
Apr 08 11:12:27 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:27 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d" returned: 0 in 0.619s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:27 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d
Apr 08 11:12:27 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:27 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0" returned: 0 in 0.453s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.697s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249438247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=029db9ee-fef0-4b0a-8984-664fd770bd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume 029db9ee-fef0-4b0a-8984-664fd770bd8c {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:27 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a6326e-c732-4f9c-bd6f-5ef00d56deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3432f22-710c-4088-83bd-14459499cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:27 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c 1073741824
Apr 08 11:12:27 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:27 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 (46e4e39b-e4b0-45df-b11c-7757c938e9f0): created successfully
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3432f22-710c-4088-83bd-14459499cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:27 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (35b21563-f66b-4c56-b2b3-a52890be56b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:27 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-75d60ecd-74a7-45f4-b083-d8d607a29453 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:28 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-16f79879-68db-49b1-b538-f5b0702bf70d" returned: 0 in 0.536s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-16f79879-68db-49b1-b538-f5b0702bf70d" released by "delete_volume" :: held 1.189s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Created reservations ['6129176c-be28-40dd-bb8b-4b6eb24346fb', '926340bd-722b-4602-abb8-5ab3952eb7a5', '23b0e3b9-baf9-4b16-9363-1c74e2473a1c', '2401e8a5-e041-4c45-a2be-94d81ee3b6b1'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:28 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:28 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:28 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c 1073741824" returned: 0 in 0.677s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:28 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c
Apr 08 11:12:28 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:28 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.466s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:28 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Deleted volume successfully.
Apr 08 11:12:28 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-fe8ce587-6721-4d69-9716-1e686d5e33fc tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-16f79879-68db-49b1-b538-f5b0702bf70d-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:29 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c" returned: 0 in 0.429s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.571s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1348768698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e5456b-5541-4787-94ff-f14199556efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:21Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume 45e5456b-5541-4787-94ff-f14199556efd {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:29 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe6c41-911e-45f4-860a-2599c5e300fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029db9ee-fef0-4b0a-8984-664fd770bd8c', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd 1073741824
Apr 08 11:12:29 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b3ffc5-9e79-4523-9fe1-aaeda9aa3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-11b103f8-3ebe-4393-a0fe-66b2bef7400e-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:29 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-029db9ee-fef0-4b0a-8984-664fd770bd8c (029db9ee-fef0-4b0a-8984-664fd770bd8c): created successfully
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b3ffc5-9e79-4523-9fe1-aaeda9aa3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (bc7e4db5-d245-454d-ac7c-32a10a18eec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:29 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-61e19f64-c299-45c0-926e-0425a5c4cf99 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-11b103f8-3ebe-4393-a0fe-66b2bef7400e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-quobyte-11b103f8-3ebe-4393-a0fe-66b2bef7400e" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-11b103f8-3ebe-4393-a0fe-66b2bef7400e" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad393c-381c-40f1-bdd8-a5a08e577288]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:29 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e
Apr 08 11:12:29 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:29 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd 1073741824" returned: 0 in 0.571s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:29 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd
Apr 08 11:12:29 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:29 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e" returned: 0 in 0.554s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:29 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e
Apr 08 11:12:29 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Flow 'volume_create_manager' (667145e7-3834-4ca1-af30-e41fe7426cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d53d908-7684-4245-bd4c-c45e7b4ddd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d53d908-7684-4245-bd4c-c45e7b4ddd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1988303343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aab4b6-b711-40c5-9cc5-b70a2f472cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fc2ae1978c4d52ab907be35c69e751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:30Z,use_quota=True,user_id='d43a472b4d2041ba97d0c0705dae8b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a656b6-6e43-4f04-9d21-57f7eea242cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a656b6-6e43-4f04-9d21-57f7eea242cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4b011d-da8c-428f-9407-87f49c2a01f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4b011d-da8c-428f-9407-87f49c2a01f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7aab4b6-b711-40c5-9cc5-b70a2f472cb5', 'volume_name': 'volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb2eead-b566-456c-b784-5160d38f942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb2eead-b566-456c-b784-5160d38f942c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0fbfc0-c40d-40a3-8a43-027b85a13052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:29 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Volume e7aab4b6-b711-40c5-9cc5-b70a2f472cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5', 'volume_size': 1}
Apr 08 11:12:29 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:30 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd" returned: 0 in 0.521s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.498s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-365576957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3055fc9-dc3a-4087-814b-8d741e08cb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05ebad3d2e2489994aa48f1e69289d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:22Z,use_quota=True,user_id='c60950a9e99f473fb3685d83be20fcfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Creating volume c3055fc9-dc3a-4087-814b-8d741e08cb5b {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:30 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:30 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01af5dd-75b7-4620-9d98-e2cf81ef46c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e5456b-5541-4787-94ff-f14199556efd', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef50922-e332-467a-b3d3-b0ac434ce0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-11b103f8-3ebe-4393-a0fe-66b2bef7400e" returned: 0 in 0.480s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:30 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b 1073741824
Apr 08 11:12:30 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-11b103f8-3ebe-4393-a0fe-66b2bef7400e" released by "delete_volume" :: held 1.071s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:30 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-45e5456b-5541-4787-94ff-f14199556efd (45e5456b-5541-4787-94ff-f14199556efd): created successfully
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef50922-e332-467a-b3d3-b0ac434ce0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (35678118-d115-4a85-a9e2-1a30c353f655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ffcb1987-9ceb-4150-bca6-aef8d82f89e9 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Created reservations ['cf586bf0-015e-44f7-92e4-f80429b2bc0d', '002c34e3-481f-4c1a-a424-85fb33bd7bf2', '75592290-7cc2-42e1-8402-5725deaa3267', 'c113537f-8d7c-450b-b435-4536b954d32d'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:30 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:30 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:30 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b 1073741824" returned: 0 in 0.501s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:30 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b
Apr 08 11:12:30 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:30 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.441s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:30 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Deleted volume successfully.
Apr 08 11:12:30 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a869c795-db34-4073-91c9-b123f984a1e6 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-11b103f8-3ebe-4393-a0fe-66b2bef7400e-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:31 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b" returned: 0 in 0.399s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.955s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3-14865123-71ab-4762-8e82-47769923e3e0" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=110,cinder:UPDATE=166,cinder:INSERT=36,cinder:DELETE=18 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a6505-1c01-4e1d-a32d-f996507b6b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a76f737-41b3-4fde-9bdb-d288051df238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:31 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Volume volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b (c3055fc9-dc3a-4087-814b-8d741e08cb5b): created successfully
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a76f737-41b3-4fde-9bdb-d288051df238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Flow 'volume_create_manager' (a3254033-0dbe-4492-a438-7b4f87a3e67e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3-14865123-71ab-4762-8e82-47769923e3e0" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Creating volume 14865123-71ab-4762-8e82-47769923e3e0 from snapshot db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ba797ada-1a38-4e71-bb52-97c90f48b41a tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created volume successfully.
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] snapshot: db599831-3bfa-40fe-821a-7926e79207d3, volume: 14865123-71ab-4762-8e82-47769923e3e0,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecefb3a3-14e0-41e6-8834-cad3279418f2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:31 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:31 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-c3055fc9-dc3a-4087-814b-8d741e08cb5b-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "cinder-quobyte-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-c3055fc9-dc3a-4087-814b-8d741e08cb5b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" acquired by "delete_volume" :: waited 0.016s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb2bdf3-9dfe-42eb-997c-666e6fbd462f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:31 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b
Apr 08 11:12:31 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-c3055fc9-dc3a-4087-814b-8d741e08cb5b" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-c3055fc9-dc3a-4087-814b-8d741e08cb5b" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c45ec2-b9c3-4370-9f59-cf2e614ff0dc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:31 devstack sudo[90819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b
Apr 08 11:12:31 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:31 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c61eb9-1bc7-489b-a428-e7d5319bff48]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:31 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:31 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:31 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:31 devstack sudo[90831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b
Apr 08 11:12:31 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:31 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:31 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:32 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b
Apr 08 11:12:32 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:32 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:32 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0
Apr 08 11:12:32 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:32 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" returned: 0 in 0.402s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-quobyte-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b" released by "delete_volume" :: held 0.908s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Created reservations ['f87a4741-4d36-4512-b107-05ec1dc11803', '4dcdb79f-8e3d-4050-a76a-9aabc1783c28', '191cc200-2d78-4614-8298-6b78d833a3ce', 'b4b6f5c3-f4c7-4633-85fd-af227bf795cf'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:32 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:32 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:32 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c3055fc9-dc3a-4087-814b-8d741e08cb5b" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-c3055fc9-dc3a-4087-814b-8d741e08cb5b" released by "delete_volume" :: held 0.981s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['e31527fc-0a8b-4a8a-acb5-eca9295a39ff', '0441526d-e92d-4cbd-abf7-52838d36db6a', 'c5e5bf6c-7994-43aa-b79b-d865bd0da6e5', '36128d65-f29b-4189-8941-dae0975b78a7'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:32 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:32 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:32 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:33 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.834s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:33 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Deleted volume successfully.
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-04240a6e-368a-4f9e-9ac4-bc0543f035c5 tempest-CreateVolumesFromImageTest-1514075259 None] Lock "cinder-0a203e7c-6c5b-41cd-a7bb-88bcd9253d7b-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-45e5456b-5541-4787-94ff-f14199556efd-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-45e5456b-5541-4787-94ff-f14199556efd-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-45e5456b-5541-4787-94ff-f14199556efd" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-45e5456b-5541-4787-94ff-f14199556efd" acquired by "delete_volume" :: waited 0.024s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1999d28-1d0e-4e3d-95d0-9c890f756c62]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:33 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:34 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 1.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:34 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0160757e-220e-4fa6-b971-8edc94c9194d tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-c3055fc9-dc3a-4087-814b-8d741e08cb5b-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:34 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd
Apr 08 11:12:34 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:34 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0" returned: 0 in 2.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c9f35-5548-423f-a79c-5e6e4053a21a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:34 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:34 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:34 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd" returned: 0 in 0.844s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:34 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:34 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd
Apr 08 11:12:34 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:35 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-45e5456b-5541-4787-94ff-f14199556efd" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-45e5456b-5541-4787-94ff-f14199556efd" released by "delete_volume" :: held 1.381s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['127de4bd-02a3-4cef-8a48-05bf4af3aff8', 'c0e856b2-1fa1-4bd6-8515-f501baef3829', '0b4c53df-ae21-4653-a4cc-1d49d008e0bb', '23e8d0e6-3222-46d6-bfb4-dd50bd9f1cff'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:35 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:35 devstack sudo[90882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:35 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.759s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a, size 1024.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Converted 1024.00 MB image at 419.24 MB/s
Apr 08 11:12:35 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 is being set with open permissions: ugo+rw
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:35 devstack sudo[90884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0
Apr 08 11:12:35 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (a8034df9-a356-40c5-857c-243f9b8e1cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b8d79-ebd5-496d-bed4-3e9327e2f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64b8d79-ebd5-496d-bed4-3e9327e2f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002355351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0cdd5-e821-49d6-a43b-e58c61267e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:35Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dcd24-c216-4182-bde0-95e34e288a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (497dcd24-c216-4182-bde0-95e34e288a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed553b-61f8-4ddc-8179-df785de04cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ed553b-61f8-4ddc-8179-df785de04cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e0cdd5-e821-49d6-a43b-e58c61267e78', 'volume_name': 'volume-92e0cdd5-e821-49d6-a43b-e58c61267e78', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e88bb48-f56e-46ef-a169-e4e20362161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e88bb48-f56e-46ef-a169-e4e20362161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb9cf69-f3e2-46df-b782-2302f5d5d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume 92e0cdd5-e821-49d6-a43b-e58c61267e78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e0cdd5-e821-49d6-a43b-e58c61267e78', 'volume_size': 1}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:35 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.430s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:35 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0" returned: 0 in 0.413s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-82e4f9f5-400d-4d18-b694-33f55cb44fbc tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-45e5456b-5541-4787-94ff-f14199556efd-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" released by "_copy_volume_from_snapshot" :: held 4.689s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3-14865123-71ab-4762-8e82-47769923e3e0" released by "_create_volume_from_snapshot" :: held 4.709s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.744s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.040s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1988303343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aab4b6-b711-40c5-9cc5-b70a2f472cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fc2ae1978c4d52ab907be35c69e751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:30Z,use_quota=True,user_id='d43a472b4d2041ba97d0c0705dae8b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Creating volume e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:35 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 1073741824
Apr 08 11:12:35 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed4dc8fc-d80b-4d73-92c7-729b5f9cc3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14865123-71ab-4762-8e82-47769923e3e0', 'volume_size': 1, 'snapshot_id': 'db599831-3bfa-40fe-821a-7926e79207d3'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcbf92a-2dbf-4941-a8b1-9fcb16ed4d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Volume volume-14865123-71ab-4762-8e82-47769923e3e0 (14865123-71ab-4762-8e82-47769923e3e0): created successfully
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcbf92a-2dbf-4941-a8b1-9fcb16ed4d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:35 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (fa0f3c86-9f53-43cf-ad7b-94f9bad09494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:35 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-daa55c0a-9771-4211-b575-da3254db0125 tempest-VolumeDependencyTests-1765098460 None] Created volume successfully.
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-029db9ee-fef0-4b0a-8984-664fd770bd8c-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-029db9ee-fef0-4b0a-8984-664fd770bd8c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-029db9ee-fef0-4b0a-8984-664fd770bd8c" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-029db9ee-fef0-4b0a-8984-664fd770bd8c" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d10fe3-76f6-4802-89b5-746fc543043a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:36 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c
Apr 08 11:12:36 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:36 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 1073741824" returned: 0 in 0.503s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:36 devstack sudo[90896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:36 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:36 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:36 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c
Apr 08 11:12:36 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-db599831-3bfa-40fe-821a-7926e79207d3-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-db599831-3bfa-40fe-821a-7926e79207d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Deleting offline snapshot db599831-3bfa-40fe-821a-7926e79207d3 of volume 85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] snapshot_file for this snap is: volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b55e3-4abb-4d31-bdcc-b3f9cb47042b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:36 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.417s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.314s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1002355351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e0cdd5-e821-49d6-a43b-e58c61267e78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:35Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume 92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:36 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0fbfc0-c40d-40a3-8a43-027b85a13052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:36 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 1073741824
Apr 08 11:12:36 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336fb40e-dc5c-4db6-a05a-2c8b723a6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:36 devstack sudo[90904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:36 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:36 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Volume volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 (e7aab4b6-b711-40c5-9cc5-b70a2f472cb5): created successfully
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (336fb40e-dc5c-4db6-a05a-2c8b723a6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:36 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Flow 'volume_create_manager' (667145e7-3834-4ca1-af30-e41fe7426cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:36 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-7bea9afb-7647-4f75-9168-a6327586f48d tempest-SnapshotDependencyTests-1061739084 None] Created volume successfully.
Apr 08 11:12:37 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-029db9ee-fef0-4b0a-8984-664fd770bd8c" returned: 0 in 0.477s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-029db9ee-fef0-4b0a-8984-664fd770bd8c" released by "delete_volume" :: held 1.069s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['98a14970-795f-47c1-bffb-2b93d066e9ce', '1d5434d7-5aa5-4de1-a74a-e9d2a2136091', '073ee7bb-7b3d-4426-a834-65618a692fb4', '2f221044-0d57-4c6d-b812-abe05e78a048'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:37 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:37 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:37 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.528s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea148821-ef13-4cfd-a8af-d613ee9ba5ce]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:37 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:37 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:37 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 1073741824" returned: 0 in 0.615s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:37 devstack sudo[90921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78
Apr 08 11:12:37 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:37 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.496s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e4d16478-240e-44c2-8a10-fe5fed931831 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-029db9ee-fef0-4b0a-8984-664fd770bd8c-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:37 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.560s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:37 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:37 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:37 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb9cf69-f3e2-46df-b782-2302f5d5d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e0cdd5-e821-49d6-a43b-e58c61267e78', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd8252-67d7-46e4-a1a2-3b89650bc538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Creating offline snapshot cdef975d-42e0-4700-8551-651244ccf21a of volume e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:12:37 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 (92e0cdd5-e821-49d6-a43b-e58c61267e78): created successfully
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39bd8252-67d7-46e4-a1a2-3b89650bc538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (a8034df9-a356-40c5-857c-243f9b8e1cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6baeb-9947-4797-b787-4ee3286ea4a2]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:37 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:37 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-48efc56f-034c-42ed-a434-bc884fa33eaf tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:38 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:38 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-46e4e39b-e4b0-45df-b11c-7757c938e9f0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-46e4e39b-e4b0-45df-b11c-7757c938e9f0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-46e4e39b-e4b0-45df-b11c-7757c938e9f0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-46e4e39b-e4b0-45df-b11c-7757c938e9f0" acquired by "delete_volume" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[170ded60-4d4c-4aba-9393-bca15841ab7e]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:38 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.479s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:38 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3
Apr 08 11:12:38 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:38 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0
Apr 08 11:12:38 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:38 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.537s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:38 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a 1G
Apr 08 11:12:38 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:38 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a.db599831-3bfa-40fe-821a-7926e79207d3" returned: 0 in 0.446s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-db599831-3bfa-40fe-821a-7926e79207d3" released by "_delete_snapshot" :: held 2.074s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" released by "delete_snapshot" :: held 2.084s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:38 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0" returned: 0 in 0.529s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:38 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0
Apr 08 11:12:38 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Created reservations ['5c8c3b60-79dd-4a5d-bbc7-7eed6fa3b5a5', '3f8ed607-2e6b-43f9-99ad-e21f3a127ebe', '742f18e2-1185-4d57-9343-779ab1165692', '7a110c47-99e6-4e68-b4f7-d9aef4de2db6'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:38 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Delete snapshot completed successfully.
Apr 08 11:12:38 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-cdde78c6-ad36-42ae-b89a-012ce03de633 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-db599831-3bfa-40fe-821a-7926e79207d3-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:39 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a 1G" returned: 0 in 0.548s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:39 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:39 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:39 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-46e4e39b-e4b0-45df-b11c-7757c938e9f0" returned: 0 in 0.419s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-46e4e39b-e4b0-45df-b11c-7757c938e9f0" released by "delete_volume" :: held 0.984s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['1a4f38f9-c692-41b4-8c9c-89e31b21292f', 'e4143bb1-c4d5-4a43-bb7e-385050863c72', 'a18be5b6-e079-4646-b143-b6efd738a708', 'ac867182-124b-440b-8fe6-a3bab7a8a573'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:39 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:39 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:39 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:39 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a is being set with open permissions: ugo+rw
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf0560-da33-49ae-8374-760f09820ea3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:39 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:39 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:39 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a
Apr 08 11:12:39 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:39 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:39 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1e598c85-905a-48c1-b7cb-a9a49a268df4 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-46e4e39b-e4b0-45df-b11c-7757c938e9f0-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:39 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.433s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca890ee9-cc47-468a-b514-2c08f3598069]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:39 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info
Apr 08 11:12:40 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" returned: 0 in 0.505s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:40 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a
Apr 08 11:12:40 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info" returned: 0 in 0.404s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info is being set with open permissions: ugo+rw
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info
Apr 08 11:12:40 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" returned: 0 in 0.420s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a" released by "delete_volume" :: held 0.965s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:40 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a
Apr 08 11:12:40 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['d6c82bad-de77-4280-bd6d-8050b999e32a', 'c9b35806-9316-4870-a9bb-4cdfa25b0cea', 'a4c30dc6-59a9-4c98-9c18-3013c5cdd5cc', 'bcc34d9d-d9ce-4949-b9f4-41d707f8a1b0'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:40 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-967b555a-5549-46b1-96b3-cae8ea45bb79-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-967b555a-5549-46b1-96b3-cae8ea45bb79-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "cinder-quobyte-967b555a-5549-46b1-96b3-cae8ea45bb79" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-967b555a-5549-46b1-96b3-cae8ea45bb79" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d1e81e-bb35-4e46-8155-30fffe87f737]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:40 devstack sudo[91022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79
Apr 08 11:12:40 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:40 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.info" returned: 0 in 0.494s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.970s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:40 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.175s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" returned: 0 in 0.458s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating offline snapshot 75800560-f1fb-40fb-bb87-26027acab11d of volume 92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a" released by "delete_volume" :: held 0.986s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[971024f2-5f1e-41b3-b3a7-2a0be7b26f96]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:40 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d7f5b8ae-b1cd-44bd-9b21-5348bad03dfc tempest-SnapshotDependencyTests-1061739084 None] Create snapshot completed successfully
Apr 08 11:12:40 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:41 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.471s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:41 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78
Apr 08 11:12:41 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Created reservations ['3ac6b195-963c-44e2-ac81-d5bb8de7fd4d', '555a548d-3904-4b6a-ad86-6020e48e5010', '7de7a81d-15dd-4cde-83d2-144e17fbb251', '56ae28aa-b633-4918-8419-29189ad0e7d6'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-ddd69dbb-ef22-4695-a3fa-475d13ff7e8f tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-c670d7c0-d3bc-4031-aa9f-0b9bb1f86f1a-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:41 devstack sudo[91032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:41 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:41 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79" returned: 0 in 0.524s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:41 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79
Apr 08 11:12:41 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:41 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78" returned: 0 in 0.493s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:41 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d 1G
Apr 08 11:12:41 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:41 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:41 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Deleted volume successfully.
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c523a0d8-35e1-455a-8766-d653d884fe1f tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-85da7869-bfdf-4bc0-b3a9-d61cc12ee79a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:41 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-967b555a-5549-46b1-96b3-cae8ea45bb79" returned: 0 in 0.426s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-quobyte-967b555a-5549-46b1-96b3-cae8ea45bb79" released by "delete_volume" :: held 0.967s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Created reservations ['df2f44a4-c54b-4750-b949-53f54faaa1c0', '540dd3f4-f6b4-4c27-a238-ddfd76409503', 'c4efb617-6df7-48d1-8d8b-84dca856c86b', 'f2b34e4e-5f0e-42f2-96ef-efa316a3c7a2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:41 devstack sudo[91044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:41 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:41 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d 1G" returned: 0 in 0.552s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:41 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:42 devstack sudo[91049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d
Apr 08 11:12:42 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:42 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.486s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:42 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Deleted volume successfully.
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-1fcee72c-a455-4b5a-bc37-2577303a1361 tempest-CreateVolumesFromSourceVolumeTest-398913994 None] Lock "cinder-967b555a-5549-46b1-96b3-cae8ea45bb79-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Flow 'volume_create_manager' (557a34ee-d232-4b1b-9ffb-05752882d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400a3a3-b774-4c6d-ad56-a0ea0c35a2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f400a3a3-b774-4c6d-ad56-a0ea0c35a2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44411099-8a4f-400f-a591-992b392693dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7fc2ae1978c4d52ab907be35c69e751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cdef975d-42e0-4700-8551-651244ccf21a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:42Z,use_quota=True,user_id='d43a472b4d2041ba97d0c0705dae8b90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf33db7e-abb3-4721-9f0e-f2b3954e20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf33db7e-abb3-4721-9f0e-f2b3954e20cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c0d9e7-ea55-4b94-b1e6-c992e19d3042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c0d9e7-ea55-4b94-b1e6-c992e19d3042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44411099-8a4f-400f-a591-992b392693dd', 'volume_name': 'volume-44411099-8a4f-400f-a591-992b392693dd', 'volume_size': 1, 'snapshot_id': 'cdef975d-42e0-4700-8551-651244ccf21a'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f5f16-6795-4363-baba-6cc5c66f02f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e05f5f16-6795-4363-baba-6cc5c66f02f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c36b3-e7a5-447a-aade-0f7c389e9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Volume 44411099-8a4f-400f-a591-992b392693dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44411099-8a4f-400f-a591-992b392693dd', 'volume_size': 1, 'snapshot_id': 'cdef975d-42e0-4700-8551-651244ccf21a'}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (259d504e-5944-4d1b-b3ba-9777e1c05c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789b438f-19c8-430f-b0c9-ad1a16478630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789b438f-19c8-430f-b0c9-ad1a16478630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998529102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c68c063-23de-403f-b473-357842b256d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:42Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dc955a-8a26-4a95-b41c-e722d3b01800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dc955a-8a26-4a95-b41c-e722d3b01800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed15ae-67da-430c-9e7a-a8aba6abbc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fed15ae-67da-430c-9e7a-a8aba6abbc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c68c063-23de-403f-b473-357842b256d3', 'volume_name': 'volume-5c68c063-23de-403f-b473-357842b256d3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f39406-fb85-4c3e-b226-45e70d84b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f39406-fb85-4c3e-b226-45e70d84b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dc7480-8201-4772-ba3d-156891da6547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:42 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Volume 5c68c063-23de-403f-b473-357842b256d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c68c063-23de-403f-b473-357842b256d3', 'volume_size': 1}
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:42 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d" returned: 0 in 0.539s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:42 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d is being set with open permissions: ugo+rw
Apr 08 11:12:42 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:42 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d
Apr 08 11:12:42 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:42 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d" returned: 0 in 0.473s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:43 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info
Apr 08 11:12:43 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:43 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info" returned: 0 in 0.434s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:43 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info is being set with open permissions: ugo+rw
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:43 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info
Apr 08 11:12:43 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Flow 'volume_create_manager' (5bd6d84f-31ac-4362-8548-852d554573db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de43b58-122d-49ff-ab59-a5be5e4de512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de43b58-122d-49ff-ab59-a5be5e4de512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bfe659-a6e0-444a-9167-7b39c8047b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece1ace55204253838c2bf78275514b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:44Z,use_quota=True,user_id='70612ffade904a60b31b6526def3b638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc1f55-5008-4426-94af-8ec83c89160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58dc1f55-5008-4426-94af-8ec83c89160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a36509-da66-42b1-857e-88b3c6bfdc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a36509-da66-42b1-857e-88b3c6bfdc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8bfe659-a6e0-444a-9167-7b39c8047b5f', 'volume_name': 'volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774176b-d136-4dfc-8f2c-c06d9548a5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774176b-d136-4dfc-8f2c-c06d9548a5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c20bf0-d628-430c-b007-84a4e4710092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:43 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Volume f8bfe659-a6e0-444a-9167-7b39c8047b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f', 'volume_size': 1}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:43 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.info" returned: 0 in 0.426s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.628s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a-44411099-8a4f-400f-a591-992b392693dd" by "_create_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:43 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0663978a-30e8-460d-80bc-0d3aa14e325f tempest-CreateVolumesFromSnapshotTest-1435927623 None] Create snapshot completed successfully
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a-44411099-8a4f-400f-a591-992b392693dd" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Creating volume 44411099-8a4f-400f-a591-992b392693dd from snapshot cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] snapshot: cdef975d-42e0-4700-8551-651244ccf21a, volume: 44411099-8a4f-400f-a591-992b392693dd,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[1381039f-0baa-4d41-88b7-1e73ddc098b1]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:43 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:44 devstack sudo[91064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:44 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:44 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.459s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[663e0208-7bc7-4f61-80f2-2f3a2af15d5f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:44 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:44 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:44 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:12:44 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:44 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd
Apr 08 11:12:44 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (821cadb1-005e-4a70-bafd-ee8a437da8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9528bb-d64f-4ef1-bffe-2a397155eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9528bb-d64f-4ef1-bffe-2a397155eee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504098234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491519a2-ed42-4980-8b6d-503cc4043897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:45Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af5a7a1-9f74-480d-82bc-40d2a811054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af5a7a1-9f74-480d-82bc-40d2a811054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad54652-a959-4c2f-bfbf-62997d2a3f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad54652-a959-4c2f-bfbf-62997d2a3f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491519a2-ed42-4980-8b6d-503cc4043897', 'volume_name': 'volume-491519a2-ed42-4980-8b6d-503cc4043897', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d828d9e0-9de2-4a9c-991d-48243625bd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d828d9e0-9de2-4a9c-991d-48243625bd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2bfc78-38fe-4757-8c26-c5a471718be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume 491519a2-ed42-4980-8b6d-503cc4043897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491519a2-ed42-4980-8b6d-503cc4043897', 'volume_size': 1}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (9b453474-6470-4bec-92cd-6510a7ff42f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283908a5-d42a-4aac-ab27-8a522bc6589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283908a5-d42a-4aac-ab27-8a522bc6589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410187599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44b715-0d56-4319-98b9-8a1db8dab55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:45Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e44dd-9c20-4741-a73e-b455b5abe2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31e44dd-9c20-4741-a73e-b455b5abe2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f905c-c0f8-43c0-b3c1-0d9b3ffe6784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f905c-c0f8-43c0-b3c1-0d9b3ffe6784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a44b715-0d56-4319-98b9-8a1db8dab55a', 'volume_name': 'volume-6a44b715-0d56-4319-98b9-8a1db8dab55a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0a5f12-82e0-4a3e-8463-f9500c97a78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0a5f12-82e0-4a3e-8463-f9500c97a78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd3eeb2-0e00-4404-9d98-ce21d6521dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume 6a44b715-0d56-4319-98b9-8a1db8dab55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a44b715-0d56-4319-98b9-8a1db8dab55a', 'volume_size': 1}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (8f33bdb4-ff50-48d4-bed6-7740fee007a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b872f3-8e37-435b-97b3-2c4f4a67d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b872f3-8e37-435b-97b3-2c4f4a67d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508290722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724040c3-491c-498f-89a9-83cffc166da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:46Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032136f6-0abd-4b92-b845-ebb3f93020b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032136f6-0abd-4b92-b845-ebb3f93020b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706505cc-12f3-4b72-bc50-247c056c4649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706505cc-12f3-4b72-bc50-247c056c4649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724040c3-491c-498f-89a9-83cffc166da0', 'volume_name': 'volume-724040c3-491c-498f-89a9-83cffc166da0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d69ca2-5f16-4d1b-b38e-c7461125f055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d69ca2-5f16-4d1b-b38e-c7461125f055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1c1bb2-3f4d-47da-848a-0d4cdb15fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:45 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume 724040c3-491c-498f-89a9-83cffc166da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724040c3-491c-498f-89a9-83cffc166da0', 'volume_size': 1}
Apr 08 11:12:45 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (3c95ba68-0dca-42c3-9994-f8422676dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2990aac3-33bf-4a09-877f-e0d221a882c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2990aac3-33bf-4a09-877f-e0d221a882c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690610620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70ad01c-b131-45e1-9134-7b9bab61a19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:46Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ea145-3483-41cf-ad95-6e487bfe0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48ea145-3483-41cf-ad95-6e487bfe0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d2a21e-0f92-4e8c-944c-f4a6cefc18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d2a21e-0f92-4e8c-944c-f4a6cefc18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e70ad01c-b131-45e1-9134-7b9bab61a19d', 'volume_name': 'volume-e70ad01c-b131-45e1-9134-7b9bab61a19d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1540962-3e34-4bef-bb5d-2901cb214430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1540962-3e34-4bef-bb5d-2901cb214430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2332d0-4360-43d4-a332-221f72466074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:46 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume e70ad01c-b131-45e1-9134-7b9bab61a19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e70ad01c-b131-45e1-9134-7b9bab61a19d', 'volume_size': 1}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (5cc21ed8-f6f7-4082-b0cf-dc3fedfbcf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:46 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac7e1d5-fc17-42fa-b0a7-91c50385e7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac7e1d5-fc17-42fa-b0a7-91c50385e7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843425211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfd998f-b23a-43c1-be83-14deb8e2d0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:47Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25706b7a-d51c-4b01-9e1b-9ea6fed2c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25706b7a-d51c-4b01-9e1b-9ea6fed2c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a023d8-1718-4d44-a6ea-ee8e0876168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a023d8-1718-4d44-a6ea-ee8e0876168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfd998f-b23a-43c1-be83-14deb8e2d0b0', 'volume_name': 'volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb5e83-2399-4b95-9a71-41beccd83843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb5e83-2399-4b95-9a71-41beccd83843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52861d-4388-4ada-8c7b-153ce7033671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:47 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume 8dfd998f-b23a-43c1-be83-14deb8e2d0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0', 'volume_size': 1}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:47 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd" returned: 0 in 2.317s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc08c667-c2e5-4118-a1c3-c0de4dd06b3b]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:47 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:47 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:47 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.588s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:12:47 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Converted 1024.00 MB image at 441.83 MB/s
Apr 08 11:12:47 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd is being set with open permissions: ugo+rw
Apr 08 11:12:47 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:47 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd
Apr 08 11:12:47 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:48 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd" returned: 0 in 0.391s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" released by "_copy_volume_from_snapshot" :: held 4.281s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a-44411099-8a4f-400f-a591-992b392693dd" released by "_create_volume_from_snapshot" :: held 4.299s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.323s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.741s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998529102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c68c063-23de-403f-b473-357842b256d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:42Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Creating volume 5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:48 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:48 devstack sudo[91102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 1073741824
Apr 08 11:12:48 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6c36b3-e7a5-447a-aade-0f7c389e9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44411099-8a4f-400f-a591-992b392693dd', 'volume_size': 1, 'snapshot_id': 'cdef975d-42e0-4700-8551-651244ccf21a'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ed582-7fb0-44e9-ad38-92cb21f196e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:48 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Volume volume-44411099-8a4f-400f-a591-992b392693dd (44411099-8a4f-400f-a591-992b392693dd): created successfully
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ed582-7fb0-44e9-ad38-92cb21f196e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Flow 'volume_create_manager' (557a34ee-d232-4b1b-9ffb-05752882d35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:48 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3a84cd33-6f3a-4088-ac38-896b239931c8 tempest-SnapshotDependencyTests-1061739084 None] Created volume successfully.
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-cdef975d-42e0-4700-8551-651244ccf21a-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-cdef975d-42e0-4700-8551-651244ccf21a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Deleting offline snapshot cdef975d-42e0-4700-8551-651244ccf21a of volume e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] snapshot_file for this snap is: volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2846433-ca60-4e1b-807e-f000a8697506]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:48 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 1073741824" returned: 0 in 0.508s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:48 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:48 devstack sudo[91108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:12:48 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:48 devstack sudo[91107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:48 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:49 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.399s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.525s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8bfe659-a6e0-444a-9167-7b39c8047b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece1ace55204253838c2bf78275514b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:44Z,use_quota=True,user_id='70612ffade904a60b31b6526def3b638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Creating volume f8bfe659-a6e0-444a-9167-7b39c8047b5f {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:49 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dc7480-8201-4772-ba3d-156891da6547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c68c063-23de-403f-b473-357842b256d3', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760a162-0fb5-4b5e-95eb-58048c50cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:49 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f 1073741824
Apr 08 11:12:49 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:49 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.485s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:12:49 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Volume volume-5c68c063-23de-403f-b473-357842b256d3 (5c68c063-23de-403f-b473-357842b256d3): created successfully
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4760a162-0fb5-4b5e-95eb-58048c50cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (259d504e-5944-4d1b-b3ba-9777e1c05c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703bd73-d8d4-4139-b448-8ce56a1081b9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:49 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-d50bf4fa-b179-479d-833e-ccfd1f910001 tempest-VolumeDependencyTests-1765098460 None] Created volume successfully.
Apr 08 11:12:49 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:49 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:49 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f 1073741824" returned: 0 in 0.462s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:49 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f
Apr 08 11:12:49 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:49 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.498s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:49 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:49 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:49 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (e015da2e-2ed9-44c8-974a-9023bec67ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51040cbe-b5ad-4a23-93ec-2d1c9caa88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51040cbe-b5ad-4a23-93ec-2d1c9caa88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2367085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0133d92-8c40-458a-8ab9-e8caf38ee653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a7705b38660489d889813205c4b654b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5c68c063-23de-403f-b473-357842b256d3,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:50Z,use_quota=True,user_id='5962b0b3b6fe48dcb2a84c11a5334a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9d2e6-fb23-4466-a288-5ee4dbb3963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e9d2e6-fb23-4466-a288-5ee4dbb3963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b1c947-d569-46ee-9131-be9e5b60fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b1c947-d569-46ee-9131-be9e5b60fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd0133d92-8c40-458a-8ab9-e8caf38ee653', 'volume_name': 'volume-d0133d92-8c40-458a-8ab9-e8caf38ee653', 'volume_size': 1, 'source_volid': '5c68c063-23de-403f-b473-357842b256d3', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea29015c-0195-4d70-9c8c-594c1a727d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea29015c-0195-4d70-9c8c-594c1a727d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651cf891-dab5-4738-88bf-aa7e5be4f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Volume d0133d92-8c40-458a-8ab9-e8caf38ee653: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d0133d92-8c40-458a-8ab9-e8caf38ee653', 'volume_size': 1, 'source_volid': '5c68c063-23de-403f-b473-357842b256d3', 'source_volstatus': 'available'}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f" returned: 0 in 0.530s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504098234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491519a2-ed42-4980-8b6d-503cc4043897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:45Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume 491519a2-ed42-4980-8b6d-503cc4043897 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:50 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c20bf0-d628-430c-b007-84a4e4710092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bcd4e1-b533-439e-be8e-87e9276b6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:50 devstack sudo[91133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 1073741824
Apr 08 11:12:50 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:50 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Volume volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f (f8bfe659-a6e0-444a-9167-7b39c8047b5f): created successfully
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bcd4e1-b533-439e-be8e-87e9276b6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Flow 'volume_create_manager' (5bd6d84f-31ac-4362-8548-852d554573db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:50 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c81a0a91-ad51-44c8-9991-ac38158ac325 tempest-CinderUnicodeTest-803660051 None] Created volume successfully.
Apr 08 11:12:50 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.525s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:50 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a
Apr 08 11:12:50 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:50 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:50 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5.cdef975d-42e0-4700-8551-651244ccf21a" returned: 0 in 0.429s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 1073741824" returned: 0 in 0.482s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-cdef975d-42e0-4700-8551-651244ccf21a" released by "_delete_snapshot" :: held 2.018s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" released by "delete_snapshot" :: held 2.028s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:50 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897
Apr 08 11:12:50 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Created reservations ['7864eccb-949f-43f8-84c9-e074ba58a024', '229262ad-9210-400d-bbf0-1f586f3d5bd6', '10231de6-0997-4a4a-8459-f98555df7766', 'a6ceb5eb-ecee-4cb0-8144-4430760afcbe'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:50 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Delete snapshot completed successfully.
Apr 08 11:12:50 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-67770cf6-f7c6-4363-a6e8-bec8a2b2e2b4 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-cdef975d-42e0-4700-8551-651244ccf21a-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:51 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897" returned: 0 in 0.434s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.753s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410187599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44b715-0d56-4319-98b9-8a1db8dab55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:45Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume 6a44b715-0d56-4319-98b9-8a1db8dab55a {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:51 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2bfc78-38fe-4757-8c26-c5a471718be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491519a2-ed42-4980-8b6d-503cc4043897', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2976a7-933f-446d-89c9-6e71fd42b518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a 1073741824
Apr 08 11:12:51 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:51 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-491519a2-ed42-4980-8b6d-503cc4043897 (491519a2-ed42-4980-8b6d-503cc4043897): created successfully
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2976a7-933f-446d-89c9-6e71fd42b518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (821cadb1-005e-4a70-bafd-ee8a437da8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:51 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-ea7c7ca0-b676-4835-ae66-9424ccb0f961 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82670) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Flow 'volume_create_manager' (e71aa1c0-a202-4c37-8eb4-380f2f6e8b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b006504-1f2b-4d96-9e96-47e3a1fdd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b006504-1f2b-4d96-9e96-47e3a1fdd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1680608530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827e45e0-7e6c-4549-b968-b8879b223b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece1ace55204253838c2bf78275514b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:51Z,use_quota=True,user_id='70612ffade904a60b31b6526def3b638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e35086-c191-483a-ab07-fc3716af5283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e35086-c191-483a-ab07-fc3716af5283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbab521-05cf-429c-b772-1ed97a16d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dbab521-05cf-429c-b772-1ed97a16d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827e45e0-7e6c-4549-b968-b8879b223b6f', 'volume_name': 'volume-827e45e0-7e6c-4549-b968-b8879b223b6f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8023d7-a3a7-4ac8-8daa-a8e9484bab24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8023d7-a3a7-4ac8-8daa-a8e9484bab24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f74392c-58b4-4ae9-8f19-d858f36e5d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:51 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Volume 827e45e0-7e6c-4549-b968-b8879b223b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827e45e0-7e6c-4549-b968-b8879b223b6f', 'volume_size': 1}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:51 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a 1073741824" returned: 0 in 0.512s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:51 devstack sudo[91150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a
Apr 08 11:12:51 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4ec325-cae8-43a9-9604-5cad790b3722]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:51 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:51 devstack sudo[91152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:51 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:52 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a" returned: 0 in 0.412s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.389s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1508290722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724040c3-491c-498f-89a9-83cffc166da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:46Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume 724040c3-491c-498f-89a9-83cffc166da0 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:52 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd3eeb2-0e00-4404-9d98-ce21d6521dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a44b715-0d56-4319-98b9-8a1db8dab55a', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1658cf-0777-472a-9e79-e5fcfea21656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:52 devstack sudo[91155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 1073741824
Apr 08 11:12:52 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:52 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-6a44b715-0d56-4319-98b9-8a1db8dab55a (6a44b715-0d56-4319-98b9-8a1db8dab55a): created successfully
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1658cf-0777-472a-9e79-e5fcfea21656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (9b453474-6470-4bec-92cd-6510a7ff42f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:52 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-2d1c6a35-b4d6-4209-9b66-b139ff7954d9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:52 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.487s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:52 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5
Apr 08 11:12:52 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:52 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 1073741824" returned: 0 in 0.491s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:52 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0
Apr 08 11:12:52 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:52 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" returned: 0 in 0.410s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5" released by "delete_volume" :: held 0.923s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Created reservations ['01237b98-19cc-4629-b643-2150b1569ae5', 'ea306830-0e72-4495-ae8d-28cf3705df1f', '61b78454-444f-4a0f-99f3-380550f816a3', '89bd0e1c-2cc7-4677-b530-35c99cc6282a'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:52 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:52 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-44411099-8a4f-400f-a591-992b392693dd-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:52 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-44411099-8a4f-400f-a591-992b392693dd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d79ce-6f1a-4fd2-8baf-e4bf61e1ac7f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:53 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0" returned: 0 in 0.430s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.412s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690610620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e70ad01c-b131-45e1-9134-7b9bab61a19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:46Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume e70ad01c-b131-45e1-9134-7b9bab61a19d {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:53 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d1c1bb2-3f4d-47da-848a-0d4cdb15fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724040c3-491c-498f-89a9-83cffc166da0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578cd6c-a040-4459-bbb2-10fb4f65c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:53 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d 1073741824
Apr 08 11:12:53 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:53 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-724040c3-491c-498f-89a9-83cffc166da0 (724040c3-491c-498f-89a9-83cffc166da0): created successfully
Apr 08 11:12:53 devstack sudo[91171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd
Apr 08 11:12:53 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578cd6c-a040-4459-bbb2-10fb4f65c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (8f33bdb4-ff50-48d4-bed6-7740fee007a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:53 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-de6e705b-ce95-4464-a0cf-6cde495b4bfc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:53 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.443s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:53 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Deleted volume successfully.
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-3c669e2b-64a8-4e47-b397-b4ccbcd64483 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-e7aab4b6-b711-40c5-9cc5-b70a2f472cb5-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:53 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd" returned: 0 in 0.509s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:53 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd
Apr 08 11:12:53 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:53 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d 1073741824" returned: 0 in 0.533s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:53 devstack sudo[91184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d
Apr 08 11:12:53 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:53 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-44411099-8a4f-400f-a591-992b392693dd" returned: 0 in 0.400s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-quobyte-44411099-8a4f-400f-a591-992b392693dd" released by "delete_volume" :: held 0.930s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:53 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Created reservations ['e5dc33c4-f3aa-4285-83fd-fcdcced2688f', '053f692f-b7c0-45df-84af-a2fe6f312586', 'b997268b-1e67-444c-98d6-a4d7f99f7718', '404af32f-320e-4212-b272-9b9a1d56a2d2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:54 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d" returned: 0 in 0.404s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.912s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843425211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfd998f-b23a-43c1-be83-14deb8e2d0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee0328ff38e417289caf3ac83457f8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:47Z,use_quota=True,user_id='19030cc4f0dd48dfb5b18788a9d9bbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Creating volume 8dfd998f-b23a-43c1-be83-14deb8e2d0b0 {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:54 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:54 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:12:54 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2332d0-4360-43d4-a332-221f72466074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e70ad01c-b131-45e1-9134-7b9bab61a19d', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f7534a-081d-4215-bfa1-2781c9f3b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:54 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-e70ad01c-b131-45e1-9134-7b9bab61a19d (e70ad01c-b131-45e1-9134-7b9bab61a19d): created successfully
Apr 08 11:12:54 devstack sudo[91190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 1073741824
Apr 08 11:12:54 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f7534a-081d-4215-bfa1-2781c9f3b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (3c95ba68-0dca-42c3-9994-f8422676dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-f64c25ec-627f-415f-a1bf-f1efec0ef68d tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:54 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.457s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:54 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Deleted volume successfully.
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-c864c622-fa27-4cda-93e2-e305aa6bf275 tempest-SnapshotDependencyTests-1061739084 None] Lock "cinder-44411099-8a4f-400f-a591-992b392693dd-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:54 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 1073741824" returned: 0 in 0.571s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:54 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:54 devstack sudo[91196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0
Apr 08 11:12:54 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:55 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" returned: 0 in 0.393s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.813s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:55 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Cloning volume 5c68c063-23de-403f-b473-357842b256d3 to volume d0133d92-8c40-458a-8ab9-e8caf38ee653
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52861d-4388-4ada-8c7b-153ce7033671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d728bf-b754-4e8e-bfb4-a386307404c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:12:55 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Volume volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 (8dfd998f-b23a-43c1-be83-14deb8e2d0b0): created successfully
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d728bf-b754-4e8e-bfb4-a386307404c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Flow 'volume_create_manager' (5cc21ed8-f6f7-4082-b0cf-dc3fedfbcf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Creating offline snapshot d3fe6608-8634-4b9d-9da8-0a17ec54b15c of volume 5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:12:55 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-6b9b3085-bc39-49e4-80ca-86267d3a89fc tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created volume successfully.
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d6d9cc-8bd0-4ce8-b896-979ae7c9f4e4]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:55 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:12:55 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-8dfd998f-b23a-43c1-be83-14deb8e2d0b0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-8dfd998f-b23a-43c1-be83-14deb8e2d0b0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea90d5-6b34-40c4-914f-d9720c4a1064]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:55 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0
Apr 08 11:12:55 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:55 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.577s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:55 devstack sudo[91207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c 1G
Apr 08 11:12:55 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:55 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:55 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:55 devstack sudo[91212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0
Apr 08 11:12:55 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:56 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c 1G" returned: 0 in 0.507s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c68c063-23de-403f-b473-357842b256d3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:56 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c68c063-23de-403f-b473-357842b256d3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:12:56 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:56 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" returned: 0 in 0.510s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-8dfd998f-b23a-43c1-be83-14deb8e2d0b0" released by "delete_volume" :: held 1.045s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['60e9f55a-3ca0-48c3-bb39-edc7a157ba98', 'f9159a68-6f09-4440-97b2-8a41e5b01e8b', 'c8134bb7-f6eb-4215-8eaf-c44023c0d018', '5bc95440-1ee6-4a61-ace8-0401877d1d54'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:56 devstack sudo[91220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:56 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:56 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c68c063-23de-403f-b473-357842b256d3 -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.474s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:56 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c is being set with open permissions: ugo+rw
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:56 devstack sudo[91225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:12:56 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:56 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:56 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:12:56 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-462183a0-7007-4f34-801e-869ae08c4d09 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-8dfd998f-b23a-43c1-be83-14deb8e2d0b0-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:57 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.488s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:57 devstack sudo[91230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info
Apr 08 11:12:57 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-e70ad01c-b131-45e1-9134-7b9bab61a19d-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-e70ad01c-b131-45e1-9134-7b9bab61a19d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-e70ad01c-b131-45e1-9134-7b9bab61a19d" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-e70ad01c-b131-45e1-9134-7b9bab61a19d" acquired by "delete_volume" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7bc32b-1a73-4f02-9513-e7137472beec]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:57 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info" returned: 0 in 0.447s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:57 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info is being set with open permissions: ugo+rw
Apr 08 11:12:57 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:57 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info
Apr 08 11:12:57 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:57 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d
Apr 08 11:12:57 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:58 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d" returned: 0 in 0.472s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:58 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d
Apr 08 11:12:58 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:58 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.info" returned: 0 in 0.480s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" by "_copy_volume_from_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] snapshot: d3fe6608-8634-4b9d-9da8-0a17ec54b15c, volume: d0133d92-8c40-458a-8ab9-e8caf38ee653,  {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[55332a3e-0a30-495f-8fa7-64f6fba90585]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:58 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:12:58 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:58 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-e70ad01c-b131-45e1-9134-7b9bab61a19d" returned: 0 in 0.481s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-e70ad01c-b131-45e1-9134-7b9bab61a19d" released by "delete_volume" :: held 1.004s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['df2a8d6e-234f-4da5-bc13-5e8ba578a167', '6f6588dd-94bb-4fb6-89b7-c3116abb874b', '7930178b-6a9b-4730-b4b7-f737d325d226', '26388165-5dfa-4791-b5ad-479820b8d308'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:12:58 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.488s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c68c063-23de-403f-b473-357842b256d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Creating direct copy from snapshot {{(pid=82670) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2e8b1c-c2ee-4eb7-8728-45597c01eca3]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:12:58 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:58 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:12:58 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:58 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:12:58 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:59 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.476s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:12:59 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:12:59 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-dfc7175f-85af-4397-94d3-c84cbc646d62 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-e70ad01c-b131-45e1-9134-7b9bab61a19d-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.543s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.utils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Path /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 not found in is_blk_device check {{(pid=82670) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:12:59 devstack sudo[91258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653
Apr 08 11:12:59 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-724040c3-491c-498f-89a9-83cffc166da0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-724040c3-491c-498f-89a9-83cffc166da0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-724040c3-491c-498f-89a9-83cffc166da0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-724040c3-491c-498f-89a9-83cffc166da0" acquired by "delete_volume" :: waited 0.043s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[829aadbf-992f-4a06-824d-744dda947627]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:12:59 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:00 devstack sudo[91272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0
Apr 08 11:13:00 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:01 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0" returned: 0 in 1.365s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:01 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0
Apr 08 11:13:01 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:01 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653" returned: 0 in 2.252s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[0018c0ec-0e6c-4a4b-8d5b-cd8a6d7dc0ba]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:01 devstack sudo[91279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:13:01 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:01 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-724040c3-491c-498f-89a9-83cffc166da0" returned: 0 in 0.492s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-724040c3-491c-498f-89a9-83cffc166da0" released by "delete_volume" :: held 1.904s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['56ac1cf8-eda9-44e5-81bc-257c408169a1', 'f356de52-c2ab-40a5-92e6-8402a5ee1fcc', 'c6fc6476-5b53-47e9-93f1-1c93c6a8ed87', '7ede9b50-c92e-48d5-a6dd-a2f98b61ab15'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:01 devstack sudo[91283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:01 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-6a44b715-0d56-4319-98b9-8a1db8dab55a-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:01 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-6a44b715-0d56-4319-98b9-8a1db8dab55a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-6a44b715-0d56-4319-98b9-8a1db8dab55a" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-6a44b715-0d56-4319-98b9-8a1db8dab55a" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e0ac07-3362-4ea1-9e50-a382db1ac4db]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:02 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a
Apr 08 11:13:02 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:02 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.670s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.image.image_utils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Image conversion details: src /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3, size 1024.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 {{(pid=82670) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 08 11:13:02 devstack cinder-volume[82670]: INFO cinder.image.image_utils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Converted 1024.00 MB image at 454.29 MB/s
Apr 08 11:13:02 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 is being set with open permissions: ugo+rw
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:02 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653
Apr 08 11:13:02 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:02 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:02 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-157f0eb8-c842-4c94-945c-16a1600b7b5b tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-724040c3-491c-498f-89a9-83cffc166da0-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:02 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a" returned: 0 in 0.490s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:02 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a
Apr 08 11:13:02 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:02 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" released by "_copy_volume_from_snapshot" :: held 4.423s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_service.periodic_task [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82670) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-d3fe6608-8634-4b9d-9da8-0a17ec54b15c" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:02 devstack sudo[91299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:02 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d3fe6608-8634-4b9d-9da8-0a17ec54b15c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Deleting offline snapshot d3fe6608-8634-4b9d-9da8-0a17ec54b15c of volume 5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] snapshot_file for this snap is: volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6c3238-ea42-404d-a26b-a739680ff7e9]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:02 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:13:02 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:02 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-6a44b715-0d56-4319-98b9-8a1db8dab55a" returned: 0 in 0.401s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-6a44b715-0d56-4319-98b9-8a1db8dab55a" released by "delete_volume" :: held 0.915s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:02 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['e1fcf2a4-7d1b-42a9-811c-be93e3099c3b', '08cae84a-6fce-4b9f-9085-39d56562d21e', '1038f564-6b17-4e7e-80b2-6ce14f2fb393', '2649ec41-ac38-4292-8276-7cd8e764e019'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:03 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.426s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-65572a34-1375-4c92-87a4-dd370981ca22 None None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:03 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:03 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-491519a2-ed42-4980-8b6d-503cc4043897-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-491519a2-ed42-4980-8b6d-503cc4043897-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:03 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c68c063-23de-403f-b473-357842b256d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7813bd8-e606-4643-ae17-5ec65674e458]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-491519a2-ed42-4980-8b6d-503cc4043897" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-491519a2-ed42-4980-8b6d-503cc4043897" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01426b1-8996-4f96-a986-4ef95c0fcc78]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:03 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:13:03 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:03 devstack sudo[91311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897
Apr 08 11:13:03 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:03 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.470s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:03 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-24d1e692-4513-4cee-a6da-31d6d193b83e tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-6a44b715-0d56-4319-98b9-8a1db8dab55a-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:03 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.478s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:03 devstack sudo[91321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:13:03 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:03 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897" returned: 0 in 0.486s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:03 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:03 devstack sudo[91323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897
Apr 08 11:13:03 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.463s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:04 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-491519a2-ed42-4980-8b6d-503cc4043897" returned: 0 in 0.422s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-491519a2-ed42-4980-8b6d-503cc4043897" released by "delete_volume" :: held 0.930s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:04 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c
Apr 08 11:13:04 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['70878d0d-983d-45c0-8495-71d628f7c124', '2e1b8cea-b36a-426d-b02c-447e88ca8569', 'aadf69a4-6f64-4566-8d43-680590d1f7c3', '9f127062-d64d-4dee-ae36-53b5b3099396'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:04 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:04 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-75800560-f1fb-40fb-bb87-26027acab11d-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-75800560-f1fb-40fb-bb87-26027acab11d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-75800560-f1fb-40fb-bb87-26027acab11d" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-75800560-f1fb-40fb-bb87-26027acab11d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleting offline snapshot 75800560-f1fb-40fb-bb87-26027acab11d of volume 92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] snapshot_file for this snap is: volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214e3fc-28a9-4b58-8221-aa85e74dd76a]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:04 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d
Apr 08 11:13:04 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3.d3fe6608-8634-4b9d-9da8-0a17ec54b15c" returned: 0 in 0.442s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d3fe6608-8634-4b9d-9da8-0a17ec54b15c" released by "_delete_snapshot" :: held 1.925s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.501s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.054s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f4ea32ac1f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-08T09:12:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1680608530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827e45e0-7e6c-4549-b968-b8879b223b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ece1ace55204253838c2bf78275514b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-08T09:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-08T09:12:51Z,use_quota=True,user_id='70612ffade904a60b31b6526def3b638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37963713-9ee5-4932-a379-8f410ddd9265),volume_type_id=37963713-9ee5-4932-a379-8f410ddd9265)}" {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Creating volume 827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Selected osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd as target Quobyte volume. {{(pid=82670) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 08 11:13:04 devstack cinder-volume[82670]: INFO cinder.volume.drivers.remotefs [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] casted to osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f 1073741824 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651cf891-dab5-4738-88bf-aa7e5be4f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0133d92-8c40-458a-8ab9-e8caf38ee653', 'volume_size': 1, 'source_volid': '5c68c063-23de-403f-b473-357842b256d3', 'source_volstatus': 'available'}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cda53b-5aba-4489-a68f-1c8b645269f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:13:04 devstack sudo[91337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f 1073741824
Apr 08 11:13:04 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:04 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Volume volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 (d0133d92-8c40-458a-8ab9-e8caf38ee653): created successfully
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cda53b-5aba-4489-a68f-1c8b645269f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Flow 'volume_create_manager' (e015da2e-2ed9-44c8-974a-9023bec67ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.428s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:13:04 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-e251439a-140e-4ff7-95da-ddc7fa0d7267 tempest-VolumeDependencyTests-1765098460 None] Created volume successfully.
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-994705c8-ca83-45ae-9d2c-7f0d4eb25578 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-491519a2-ed42-4980-8b6d-503cc4043897-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:04 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d" returned: 0 in 0.484s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92e0cdd5-e821-49d6-a43b-e58c61267e78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1363c-efad-4914-aadb-d485ebadadc5]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:04 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78
Apr 08 11:13:04 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-5c68c063-23de-403f-b473-357842b256d3-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-5c68c063-23de-403f-b473-357842b256d3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-5c68c063-23de-403f-b473-357842b256d3" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-5c68c063-23de-403f-b473-357842b256d3" acquired by "delete_volume" :: waited 0.012s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[43956da8-3311-4da9-a5d9-71d3166c8f4f]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:04 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:05 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:13:05 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:05 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f 1073741824" returned: 0 in 0.513s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:05 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f
Apr 08 11:13:05 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:05 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78" returned: 0 in 0.520s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:05 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d
Apr 08 11:13:05 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:05 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:05 devstack sudo[91360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3
Apr 08 11:13:05 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:05 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f" returned: 0 in 0.427s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'} {{(pid=82670) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f74392c-58b4-4ae9-8f19-d858f36e5d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827e45e0-7e6c-4549-b968-b8879b223b6f', 'volume_size': 1}' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e57b06-74b3-4b86-977e-51c5d6cdd2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 08 11:13:05 devstack cinder-volume[82670]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Volume volume-827e45e0-7e6c-4549-b968-b8879b223b6f (827e45e0-7e6c-4549-b968-b8879b223b6f): created successfully
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e57b06-74b3-4b86-977e-51c5d6cdd2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82670) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Flow 'volume_create_manager' (e71aa1c0-a202-4c37-8eb4-380f2f6e8b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82670) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 08 11:13:05 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-dc4cda94-9ffa-4664-b5fe-0fadfdaf23df tempest-CinderUnicodeTest-803660051 None] Created volume successfully.
Apr 08 11:13:05 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d" returned: 0 in 0.434s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:05 devstack sudo[91365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d
Apr 08 11:13:05 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:05 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-5c68c063-23de-403f-b473-357842b256d3" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-5c68c063-23de-403f-b473-357842b256d3" released by "delete_volume" :: held 0.962s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Created reservations ['28b2df0f-1ae6-43d0-8264-60e082e5c8b8', '712801ef-35bb-4452-8fd2-4a69aa2580a2', 'bdd65afd-6332-48c9-8205-3468fdc14d03', '3215bb52-5e4c-49e6-a757-1bf64cf3eea3'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:05 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:06 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-d0133d92-8c40-458a-8ab9-e8caf38ee653-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-d0133d92-8c40-458a-8ab9-e8caf38ee653-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac4cb1c-89ef-4027-8b9f-6e76856bd0c0]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78.75800560-f1fb-40fb-bb87-26027acab11d" returned: 0 in 0.412s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-75800560-f1fb-40fb-bb87-26027acab11d" released by "_delete_snapshot" :: held 1.903s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" released by "delete_snapshot" :: held 1.913s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:06 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653
Apr 08 11:13:06 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['cb0c432b-c14c-4ef0-9687-bd7cd87ae540', 'd3db58b3-19d0-4784-b349-4cb917e5600f', '7f15e4f3-3a4d-48a1-8139-3ef38cf3fa3a', 'c94f2815-7d0a-4810-9786-6d349b6d3063'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Delete snapshot completed successfully.
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0ba1e0ba-c3bd-4480-8e57-fc76ff132dc9 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-75800560-f1fb-40fb-bb87-26027acab11d-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-92e0cdd5-e821-49d6-a43b-e58c61267e78-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-92e0cdd5-e821-49d6-a43b-e58c61267e78-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" acquired by "delete_volume" :: waited 0.017s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[87453bb9-bd4a-497a-9f8f-56c2318c2ccc]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Creating offline snapshot 47fb23ee-41b3-482d-822a-cd10b5b90856 of volume 827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee9bca-aba8-4e0f-bacc-7fd1faf25207]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:06 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Deleted volume successfully.
Apr 08 11:13:06 devstack sudo[91374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78
Apr 08 11:13:06 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-db021632-913a-477d-9f52-e68198ca8bd7 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-5c68c063-23de-403f-b473-357842b256d3-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:06 devstack sudo[91375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f
Apr 08 11:13:06 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653" returned: 0 in 0.506s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653
Apr 08 11:13:06 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78" returned: 0 in 0.517s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:06 devstack sudo[91389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78
Apr 08 11:13:06 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:06 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f" returned: 0 in 0.483s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:06 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 1G {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 1G
Apr 08 11:13:07 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-d0133d92-8c40-458a-8ab9-e8caf38ee653" returned: 0 in 0.411s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-d0133d92-8c40-458a-8ab9-e8caf38ee653" released by "delete_volume" :: held 0.937s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Created reservations ['bfb88bb7-f9af-42c4-81c5-97d2bea5a4a8', '26336ea7-5586-4219-8594-4750314e6a5b', '0b8bdef0-3dce-48a7-8d62-0989b0296218', 'cf9fe136-9c3e-4120-a312-bbb3aabf93c2'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:07 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-14865123-71ab-4762-8e82-47769923e3e0-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-14865123-71ab-4762-8e82-47769923e3e0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0672056-0a86-48e5-9301-0862ab647876]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0
Apr 08 11:13:07 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-92e0cdd5-e821-49d6-a43b-e58c61267e78" returned: 0 in 0.495s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-quobyte-92e0cdd5-e821-49d6-a43b-e58c61267e78" released by "delete_volume" :: held 1.066s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Created reservations ['36d41251-4987-4e89-8667-779b4599aff4', 'f664d3ac-a3f1-472d-bbde-f84663de3553', 'ee776e68-3a82-414a-8b9d-84dec297f260', 'ec9d880b-9751-46ae-9282-312ad7efded6'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 1G" returned: 0 in 0.570s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827e45e0-7e6c-4549-b968-b8879b223b6f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:07 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827e45e0-7e6c-4549-b968-b8879b223b6f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856
Apr 08 11:13:07 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.492s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Deleted volume successfully.
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0168dbab-e0cf-40fe-896c-7b3b0217ff96 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-d0133d92-8c40-458a-8ab9-e8caf38ee653-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:07 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0" returned: 0 in 0.558s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:07 devstack sudo[91410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0
Apr 08 11:13:07 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:07 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.417s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:07 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Deleted volume successfully.
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-187833d7-556f-4a83-a80d-de9bea5b2066 tempest-CreateVolumesFromSnapshotTest-1435927623 None] Lock "cinder-92e0cdd5-e821-49d6-a43b-e58c61267e78-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:07 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-827e45e0-7e6c-4549-b968-b8879b223b6f -F qcow2 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:07 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 is being set with open permissions: ugo+rw
Apr 08 11:13:07 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:08 devstack sudo[91416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856
Apr 08 11:13:08 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:08 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-14865123-71ab-4762-8e82-47769923e3e0" returned: 0 in 0.418s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-quobyte-14865123-71ab-4762-8e82-47769923e3e0" released by "delete_volume" :: held 0.996s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Created reservations ['f1d92865-e28b-4e1c-9cc6-86bcdfb58def', '4e86b132-2ac9-466e-840d-c909b8936f51', '7a390398-4b99-4f4c-8e7c-458315ca9b2a', '044bb2b2-e49e-405e-a920-c561769fb71e'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:08 devstack sudo[91419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:08 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:08 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856" returned: 0 in 0.444s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:08 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info
Apr 08 11:13:08 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:08 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.510s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:08 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Deleted volume successfully.
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-a688644c-8761-4ec9-8aa0-d42fba11c116 tempest-VolumeDependencyTests-1765098460 None] Lock "cinder-14865123-71ab-4762-8e82-47769923e3e0-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:08 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info" returned: 0 in 0.502s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:08 devstack cinder-volume[82670]: WARNING cinder.volume.drivers.remotefs [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info is being set with open permissions: ugo+rw
Apr 08 11:13:08 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:08 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info
Apr 08 11:13:08 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:09 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.info" returned: 0 in 0.546s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:09 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:09 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-357bfd12-e0f6-46b7-8a24-1819aa240801 tempest-CinderUnicodeTest-803660051 None] Create snapshot completed successfully
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-47fb23ee-41b3-482d-822a-cd10b5b90856-delete_snapshot" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-47fb23ee-41b3-482d-822a-cd10b5b90856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" by "delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-quobyte-47fb23ee-41b3-482d-822a-cd10b5b90856" by "_delete_snapshot" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-47fb23ee-41b3-482d-822a-cd10b5b90856" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Deleting offline snapshot 47fb23ee-41b3-482d-822a-cd10b5b90856 of volume 827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] snapshot_file for this snap is: volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[479fc89d-bd53-4fc4-a33a-d92ee5644ccf]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:10 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:10 devstack sudo[91430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856
Apr 08 11:13:10 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:11 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856" returned: 0 in 0.458s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.remotefs [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-827e45e0-7e6c-4549-b968-b8879b223b6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82670) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dddcb1-4526-4555-b7c1-678889d1846d]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:11 devstack sudo[91435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f
Apr 08 11:13:11 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:11 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f" returned: 0 in 0.469s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:11 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:11 devstack sudo[91440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856
Apr 08 11:13:11 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:12 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856" returned: 0 in 0.432s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856 {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:12 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856
Apr 08 11:13:12 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:12 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f.47fb23ee-41b3-482d-822a-cd10b5b90856" returned: 0 in 0.401s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-47fb23ee-41b3-482d-822a-cd10b5b90856" released by "_delete_snapshot" :: held 1.816s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" released by "delete_snapshot" :: held 1.828s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Created reservations ['f6f73474-7469-4356-88ee-d95209274641', 'f472400e-fd7b-40ce-95de-846d14614895', '728cf6f0-ec07-4f77-a87d-12e5c1bc45fb', 'a8ac27f9-64a2-40af-b551-a79713b8fd97'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:12 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Delete snapshot completed successfully.
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-98a190b9-ef79-4550-b5cc-9a181f8a4539 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-47fb23ee-41b3-482d-822a-cd10b5b90856-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-827e45e0-7e6c-4549-b968-b8879b223b6f-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-827e45e0-7e6c-4549-b968-b8879b223b6f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" acquired by "delete_volume" :: waited 0.006s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[df19f6b7-c2a5-41d4-ba73-f2a681ee0791]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:12 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:12 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f
Apr 08 11:13:12 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:13 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f" returned: 0 in 0.478s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:13 devstack sudo[91456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f
Apr 08 11:13:13 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:13 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-827e45e0-7e6c-4549-b968-b8879b223b6f" returned: 0 in 0.393s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-827e45e0-7e6c-4549-b968-b8879b223b6f" released by "delete_volume" :: held 0.905s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Created reservations ['31b42b28-0a03-4830-a313-e52acabb56e3', 'ab04d84c-598b-42a5-b7e2-7acba11523dd', '9076e29f-484f-44ed-9b74-efa1e36f7e23', 'a942478a-036b-4454-9515-e28ba92312f7'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:13 devstack sudo[91459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:13 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-f8bfe659-a6e0-444a-9167-7b39c8047b5f-delete_volume" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "cinder-f8bfe659-a6e0-444a-9167-7b39c8047b5f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Acquiring lock "cinder-quobyte-f8bfe659-a6e0-444a-9167-7b39c8047b5f" by "delete_volume" {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-f8bfe659-a6e0-444a-9167-7b39c8047b5f" acquired by "delete_volume" :: waited 0.007s {{(pid=82670) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d289f44-ac69-49e6-948c-99607406efc7]: (4, 'qcow2') {{(pid=83578) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 08 11:13:13 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:14 devstack sudo[91461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f
Apr 08 11:13:14 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:14 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.425s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:14 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Deleted volume successfully.
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-0500950e-1eb3-4dbe-a5d9-61728afddd51 tempest-CinderUnicodeTest-803660051 None] Lock "cinder-827e45e0-7e6c-4549-b968-b8879b223b6f-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:14 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f" returned: 0 in 0.478s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:14 devstack sudo[91467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f
Apr 08 11:13:14 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:14 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d/volume-f8bfe659-a6e0-444a-9167-7b39c8047b5f" returned: 0 in 0.404s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "cinder-quobyte-f8bfe659-a6e0-444a-9167-7b39c8047b5f" released by "delete_volume" :: held 0.902s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.quota [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Created reservations ['c63904b4-9afa-4847-b75b-6c18ab5f8624', '0d26186e-ff66-4496-a1af-1ca9d6716b3c', 'ad770940-142e-4ac6-b832-f7826406f13c', 'ed0c0d01-b589-4984-a0e7-bc3d1a689734'] {{(pid=82670) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd': None} {{(pid=82670) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG cinder.volume.drivers.quobyte [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a13cd724-692a-473f-9e0e-61aa347e8ddd'] {{(pid=82670) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.lockutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82670) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 08 11:13:14 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 08 11:13:14 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d
Apr 08 11:13:14 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 08 11:13:15 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Apr 08 11:13:15 devstack cinder-volume[82670]: DEBUG oslo_concurrency.processutils [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e1326874ec540f85d103460a54f83d3d" returned: 0 in 0.439s {{(pid=82670) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 08 11:13:15 devstack cinder-volume[82670]: DEBUG cinder.manager [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Notifying Schedulers of capabilities ... {{(pid=82670) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 08 11:13:15 devstack cinder-volume[82670]: INFO cinder.volume.manager [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Deleted volume successfully.
Apr 08 11:13:15 devstack cinder-volume[82670]: DEBUG cinder.coordination [None req-5908950e-f8e4-4f2c-be46-a44bcb5d3b3d tempest-CinderUnicodeTest-803660051 None] Lock "cinder-f8bfe659-a6e0-444a-9167-7b39c8047b5f-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82670) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 08 11:13:24 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:UPDATE=276,cinder:SELECT=204,cinder:DELETE=17,cinder:INSERT=82 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 08 11:13:25 devstack cinder-volume[82670]: DEBUG dbcounter [-] [82670] Writing DB stats cinder:SELECT=167,cinder:UPDATE=239,cinder:INSERT=49,cinder:DELETE=27 {{(pid=82670) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}